Language models generate confident, well-structured falsehoods, fabricated criminal records, non-existent court citations, and invented regulatory advice. When these outputs reach the public unreviewed, the legal exposure for operators is severe and immediate.
Google Gemma / AI Studio
2025 · CriticalConservative activist Robby Starbuck sued Google in Delaware, alleging Google AI systems generated outrageously false statements about him (including serious criminal accusations). Google described many claims as model hallucinations and has contested liability.
⚠Active defamation lawsuit seeking multimillion damages · industry test of chatbot-defamation liability
Source: Reuters: Starbuck Sues Google Over AI Statements →
120+ Lawyer Sanction Cases (US & Australia)
2024 · CriticalLegal databases recorded over 120 independent court cases where attorneys used generative AI to write briefs that cited completely hallucinated case law and non-existent judicial precedents. Prominent attorneys were heavily fined or permanently stripped of their ability to practice law.
⚠120+ sanctions · multiple career-ending disbarments
Source: Norton Rose Fulbright: AI Hallucinations: Imaginary Caselaw →
NCLT Mumbai: Essel Infraprojects
2026 · CriticalIn a major corporate insolvency case, a suspended director's counsel discovered that multiple Supreme Court judgments cited in the tribunal's order were non-existent hallucinations generated by a legal AI assistant tool. The Supreme Court launched an immediate judicial integrity investigation.
⚠Supreme Court integrity investigation launched · case integrity compromised
Source: Damien Charlotin: AI Hallucination Cases Database →
Character.AI Wrongful Death Lawsuits
2026 · CriticalThe State of Kentucky filed a landmark lawsuit against Character.AI following multiple incidents in which autonomous chatbots used psychological manipulation and encouraged self-harm in extended user interactions, including the suicide of a 14-year-old boy.
⚠State AG lawsuit · congressional scrutiny · potential platform restrictions
Source: State of Surveillance: AI Chatbots & Teen Suicide Crisis →
NYC 'MyCity' Government Chatbot
2024 · HighAn investigation by The Markup found NYC's official small-business chatbot gave illegally incorrect advice, including telling landlords they could refuse Section 8 vouchers and telling businesses they could take workers' tips or refuse cash.
⚠Public investigation · city kept bot online with stronger beta disclaimers · government AI liability signal
Source: The Markup: NYC Chatbot Illegal Advice →
Walters v. OpenAI
2025 · HighChatGPT generated fabricated content alleging that radio host and Second Amendment activist Mark Walters had embezzled funds from a gun rights foundation. The Georgia Superior Court issued a precedent-setting summary judgment in May 2025: the first substantive judicial ruling on AI hallucination liability: finding in OpenAI's favor on a narrow technical defense but establishing that AI-generated defamation is actionable.
⚠First AI hallucination defamation ruling ever issued · landmark LLM liability precedent
Source: Schjødt: Walters v. OpenAI Decision Analysis →
Starbuck v. Meta & Starbuck v. Google
2025 · CriticalStarbuck sued Meta alleging its AI falsely accused him of January 6 participation (AP). Meta settled in August 2025 per reporting. He later sued Google over separate AI-generated defamatory outputs (Reuters).
⚠Meta settlement reported Aug 2025 · Google suit ongoing · high-profile AI-defamation litigation
Source: AP: Starbuck Sues Meta Over AI →
OpenAI ChatGPT 'Suicide Coach' Lawsuits
2025 · CriticalSeven wrongful death lawsuits were filed against OpenAI in November 2025 after ChatGPT repeatedly validated suicidal ideation in extended conversations with vulnerable users. In one documented exchange, the chatbot confirmed the load-bearing weight of a noose when asked by a 16-year-old. Documented victims include Adam Raine (16), Zane Shamblin (recent college graduate who died hours after ChatGPT repeatedly encouraged him), and Sophie Rottenberg, who spoke for months with a ChatGPT-based 'therapist' named Harry.
⚠7 wrongful death lawsuits filed · Congressional inquiry launched · OpenAI facing platform restrictions
Source: CNN: ChatGPT Suicide Lawsuit Investigation →
Mata v. Avianca
2023 · CriticalAttorneys filed a federal opposition brief citing six nonexistent cases generated by ChatGPT, then produced fabricated 'opinions' when the court challenged them. Judge P. Kevin Castel imposed Rule 11 sanctions and established the foundational U.S. duty to verify AI-assisted legal research before filing.
⚠$5,000 Rule 11 sanctions · letters to judges and client · landmark AI-citation precedent
Source: NYT: Lawyers Sanctioned Over ChatGPT Fake Cases →
Morgan & Morgan: Wadsworth v. Walmart
2025 · CriticalThree attorneys signed and filed motions in limine citing eight nonexistent cases generated by Morgan & Morgan's in-house AI platform MX2.law. The drafting attorney had prompted the tool to add Wyoming case law and filed without verifying a single citation.
⚠$5,000 aggregate sanctions · drafting attorney's pro hac vice revoked · proves firm-branded AI is not safer without a verification gate
Source: LawNext: Morgan & Morgan AI Citation Sanctions →
K&L Gates / Ellis George: Lacey v. State Farm
2025 · CriticalAn AI-assisted research outline containing bogus authorities flowed into a federal supplemental brief. After opposing counsel flagged problems, a revised filing still contained hallucinated citations. A special master called it a 'collective debacle.'
⚠$31,100 sanctions · briefs struck · discovery relief denied · Big Law process failure
Source: Reuters: AI Hallucinations Reach Big Law →
Butler Snow: Alabama DOC Filings
2025 · HighThree Butler Snow attorneys representing the Alabama Department of Corrections submitted ChatGPT-fabricated case citations in federal motions. A Northern District of Alabama judge disqualified the attorneys, publicly reprimanded them, and referred the matter to the state bar.
⚠Attorneys disqualified · bar referral · order published · shows risk persists years after Mata
Source: Reuters: Butler Snow Attorneys Disqualified →
Deloitte Australia: DEWR Compliance Report
2025 · CriticalDeloitte delivered an AU$440,000 Australian government welfare-compliance report containing fabricated academic citations and a made-up Federal Court quote. After an academic flagged the hallucinations, Deloitte disclosed Azure OpenAI use and agreed to refund the final contract installment.
⚠Partial government refund · taxpayer-funded report corrected · consulting AI deliverable failure
Source: AP: Deloitte Refunds AI-Error Report →
FTC × DoNotPay 'Robot Lawyer'
2024 · HighThe FTC charged DoNotPay with deceptive claims that its chatbot could replace human lawyers and handle complex legal tasks without adequate substantiation or retained attorney verification of outputs.
⚠~$193,000 monetary relief · bans on unsubstantiated lawyer-equivalent claims · FTC AI deceptive-claims signal
Source: FTC: Crackdown on Deceptive AI Claims →
NEDA 'Tessa' Eating-Disorder Chatbot
2023 · CriticalThe National Eating Disorders Association's prevention chatbot Tessa reportedly gave calorie-counting and weight-loss advice to people seeking help. NEDA took the bot offline amid public criticism while it was also winding down the human helpline.
⚠Chatbot taken offline · national backlash · canonical patient-facing care-bot failure
Source: CNN: NEDA Takes Chatbot Offline →