174
What is the AI vibe at work like for you?
(lemmy.ml)
A loosely moderated place to ask open-ended questions
If your post meets the following criteria, it's welcome here!
Looking for support?
Looking for a community?
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
So the LLM can run arbitrary code against your database? Or your clients can? Both sound scary as hell!
I can’t imagine the nightmare of trying to reproduce “incorrect data” and they just send you the prompt instead of the query
That could be fixed by simply logging the prompt and code executed. Maybe also give each prompt/response a reference ID and demand that in tickets. The nightmare would be actually reading the code the AI generated.
You're being silly. Clients can only prompt the AI and the AI has restricted read-only permissions on the database. Slap on a execution timeout to cover if the AI wrote an expensive query.
The real concern is the AI getting a query subtly wrong and giving the client bad info. That gets "covered" by some flimsy disclaimer.