18
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 12 Sep 2023
18 points (87.5% liked)
Technology
59583 readers
2299 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Is there another archetype of Machine Learning technologies that would be better suited to the task of locating useful information enciphered in legalese? I know Lex Machina exists, but that's more of a specialized software for someone in case law.
I don't plan on using what the Agent tells me in a court of law, nor do I plan on using it to blindly form a legal opinion. I remember watching the Legal Eagle video about a lawyer who submitted a legal brief containing case law that didn't even exist because GPT-4 hallucinated it! Sounds like a nightmarish scenario to find yourself losing your J.D. over it lol
I think an LLM+Chroma is probably as good as it gets, and who knows, it might work. Just I'd be very careful of getting screwed by the process. As I'm sure you know LLMs are right at that inflection point where they're good enough to seem trustworthy but they can still completely malfunction (and they tend to do so in ways that are actually really difficult to spot because they seem perfectly plausible.)
Yeah the Legal Eagle video was hilarious. The guy used GPT-4 to make his legal briefs, then when it hallucinated cases he lied to the judge and said he'd researched them and the cases existed, then when faced with the clearly obvious fact that they didn't, he finally came clean but still sort of tried to weasel out of responsibility for the whole thing and the judge quite rightly tore him a new one. And, I have some vague memory of it being discovered that GPT had basically tried to tell him it wasn't qualified to make his legal briefs and he insisted to it that it needed to do it anyway. It was just an absolute casserole from start to finish.