The marketing promise for premium legal RAG-based models was a hallucination-free experience. The empirical reality is different. Why?
It is a structural problem, created by the way Large Language Models are created. The process includes inputting large amounts of information. This typically includes all the publicly available information on the Internet.
The next step is
Tip of the day (and maybe the year:
Always consult more than one AI app when dealing with critical issues.
Monogamy is not the best strategy for AI. Multiple AI perspectives help with high-stakes questions, unsettled law, or anything involving tax regulations (which remain confusing even to the IRS). When two models agree, you gain
With the selection of Big Thinker Cory Doctorow this year ABA Techshow continued its practice of featuring brilliant keynote speakers. Longtime Internet users will recognize the pattern Doctorow described. AOL became worthless. Yahoo became irrelevant. The content-to-ad ratio on Facebook is overwhelming. Doctorow calls this predictable degradation “En****tification.”
Danielle Braff‘s article in
Carolyn Elefant has the receipts:
“It does not bode well for #legaltech that my $20/month ChatGPT subscription can give me a correct Bluebook citation for a public utilities commission order when my $270/month LexisNexis subscription cannot.”
As someone once said, “The times, they are a-changing.”
I like LLRX for its info on Internet marketing.
Cat Moon 😺 likes to say she “lives in the I live in the open mindedness of not knowing enough about anything.”
I dunno. She knows just about everything we need to know about one topic:
“Every single instance of an attorney filing something in court that cites a fake case generated by AI is
Implementing AI is challenging for professions where progress often means figuring out how to get your printer to work. Many lawyers are waiting until they have developed a perfect implementation strategy. They wind up doing nothing.
Lawyers can and should benefit from AI today rather than waiting to develop the world’s greatest policy. Until that
Lots of good stuff at the AI Law Librarians blog, including their prompt library. Have one to share?
AI Prompt Library for Law: Research, Drafting, Teaching and More
Gotta love it.
Is it really surprising that legal research companies are exaggerating the quality of their Artificial Intelligence apps?
The more significant finding a the new Stanford University study is that both “Westlaw and Lexis offer high quality responses.” As you might expect, the estimable Bob Ambrogi is all over this (here and here).
The