AI Hallucinations in Court The Sullivan & Cromwell Lesson

Episode 37

0:00-13:38

Recorded as a fireside chat at the ABA Law Practice Division Spring Meeting in San Diego, this special episode examines reports that Sullivan & Cromwell filed a brief containing nonexistent or inaccurate case citations and later apologized to opposing counsel and the court. Steve Embry, Jennifer Ellis, and Michael Eisenberg discuss why AI hallucinations continue to appear in legal filings despite widespread awareness of the risks. They point to ignored firm policies, time pressure, overreliance on confident-sounding AI outputs, and a lack of understanding of generative AI's limitations as key contributing factors. The discussion also explores how these failures relate to lawyers' ethical duties of competence, candor, and supervision. The speakers emphasize that legal citations should always be independently verified using traditional legal research tools—not AI—such as Shepardizing in Lexis or Westlaw. They also stress that proper training and experience are essential for recognizing unreliable AI-generated results. 00:00 – AI Hallucinations Hit BigLaw 00:37 – Show Intro and Disclaimer 01:16 – Sullivan & Cromwell Brief Fallout 02:19 – Why Lawyers Keep Getting Burned 04:19 – Competence Rules and Citation Checks 06:53 – Workflow Reality Check 08:55 – Training to Spot Hallucinations 10:45 – Verifying Citations Without AI Tools 12:55 – Closing Thoughts and Wrap-Up 13:02 – Podcast Outro and Resources

Publisher

Law Practice Today

Published

June 30, 2026

Duration

14 min

Format

Podcast

Category

Issues · Entrepreneurship

Source

RSS feed

Host

The Law Practice Division

LP

Law Practice Today

@lawpracticetoday

#aihallucinations #sullivan #cromwelllesson #nonprofit

The Nile