Supreme Court says AI-generated hallucinated precedents 'catastrophic'
The Supreme Court of India has quashed a high court judgment that relied on AI-generated fake precedents, calling such hallucinated citations "catastrophic" and warning that using artificial intelligence to produce fabricated legal authorities undermines the justice system.
Background
- The article reports on India's Supreme Court striking down a lower court verdict that cited fabricated case precedents — fake rulings that appear to have been generated by an AI tool (a phenomenon known as "hallucination," where AI models confidently invent plausible-sounding but completely false information).
- The bench sharply criticised the use of AI-created legal citations, calling the practice "catastrophic" and warning that it undermines the integrity of the judicial system. The ruling is seen as a landmark warning for legal professionals who rely on generative AI without verification.
- This follows similar incidents globally: in 2023, a US lawyer faced sanctions for citing fake AI-hallucinated cases in a federal brief (the Mata v. Avianca case). Indian courts are increasingly confronting the same problem as AI tools become common in legal research.
- The Supreme Court's strong language signals that Indian judges will treat unverified AI-generated content in court filings as a serious ethical and procedural violation, not merely a technical mistake.