AI Hallucinations Hit the Courtroom: Over 1,800 Lawyers Busted for Fake Citations

The legal profession is facing a massive credibility crisis. Over the past year, more than 1,800 court cases worldwide have been derailed by lawyers using AI-generated fake citations. In the U.S. alone, over 1,200 cases have been affected. Even top-tier legal teams from the Department of Justice and Wall Street firm Sullivan&Cromwell have been caught submitting briefs containing made-up case law and fabricated quotes.

The problem is so widespread that judges are now explicitly asking lawyers whether AI was used to draft their filings. In one instance, a Michigan judge grilled a DOJ lawyer after a nonexistent appeals court case was cited. The irony reached its peak when Anthropic, the creator of the AI chatbot Claude, had its own lawyer use the chatbot to generate a fake academic citation. Attorney Crawford Appleby sums it up:“AI can be a useful tool, but it cannot replace the lawyer’s duty of candor, competence, and independent judgment.”

This isn’t just a cautionary tale for legal professionals. It affects anyone who relies on the court system for justice. If lawyers can’t be bothered to verify what their AI spits out, how can we trust the outcomes of trials? The question now is whether courts will start banning AI use altogether or simply force lawyers to actually do their jobs. Either way, it’s going to be a messy fight. Do you think AI should be banned from courtroom use? Let us know in the comments.