These are independently reported incidents where ungoverned AI output reached customers, courts, patients, or corporate systems. Each card links a primary or major-media source (and an AIID cite when one exists). For each we name the rule class that would block, queue, or require human approval before send. Full AIID browse is below. Summaries are paraphrased; they are not legal advice.
Clinic chatbot invents medical titles: operator liable (OLG Hamm)
2026OLG Hamm, Aesthetify / Dr. Rick & Dr. Nick
German Higher Regional Court held website chatbot statements are the company's commercial acts. Invented specialist titles were unfair competition; 'the AI hallucinated' and disclaimers did not shift liability.
DataVibe gate · Capability marketing claimBLOCK professional-title / qualification claims not on an allowlist; queue medical marketing language for human review before reply.
TWW Law: OLG Hamm ruling ↗
DPD support bot swears and recommends competitors
2024DPD
UK parcel carrier's AI chat produced profanity, self-roast poetry, and competitor praise after adversarial prompts. AI layer disabled within ~24 hours after viral screenshots.
DataVibe gate · Brand & toneBLOCK profanity and competitor-recommendation language; fail closed on brand-tone denylist before the reply leaves the widget.
Reuters: DPD disables AI ↗
Mata v. Avianca: ChatGPT fabricates court citations
2023Mata v. Avianca, S.D.N.Y.
Attorneys filed ChatGPT-invented case cites in federal court, then produced fabricated opinions when challenged. Foundational U.S. Rule 11 AI-citation precedent.
DataVibe gate · Legal citation integrityQueue or BLOCK outbound filings/emails containing unverified case cites; require attorney four-eyes approval before send.
NYT: ChatGPT fake cases ↗
Morgan & Morgan in-house AI hallucinates Wyoming cites
2025Morgan & Morgan, Wadsworth v. Walmart
Firm platform MX2.law invented eight nonexistent cases used in motions in limine. Drafter's pro hac vice revoked; supervising signers sanctioned.
DataVibe gate · Legal citation integrityTreat AI-assisted briefs as gated outbound work product: citation integrity check + mandatory independent verification token before court filing.
LawNext: Morgan & Morgan sanctions ↗
K&L Gates / Ellis George sanctioned for AI brief ($31.1k)
2025K&L Gates, Ellis George, Lacey v. State Farm
AI research outline with bogus authorities entered a federal brief; a revised filing still contained hallucinations. Special master: $31,100 sanctions.
DataVibe gate · Legal citation integrityBlock unverified citation clusters; force human principal review with immutable audit of who approved which version.
Reuters: Big Law AI hallucinations ↗AIID #1073 ↗
Butler Snow attorneys disqualified over ChatGPT cites
2025Butler Snow, N.D. Alabama
Attorneys defending Alabama DOC filed ChatGPT-fabricated authorities. Judge disqualified counsel and referred them to the state bar.
DataVibe gate · Legal citation integrityFail closed on fabricated citation patterns; never auto-approve courtbound AI drafts.
Reuters: Butler Snow disqualification ↗
Deloitte AU government report full of AI fake cites
2025Deloitte Australia, DEWR
AU$440k taxpayer-funded compliance report included nonexistent academic papers and a fabricated Federal Court quote. Firm disclosed Azure OpenAI and refunded the final installment.
DataVibe gate · Legal citation integrityGate consulting deliverables before client/government publish: BLOCK unverifiable authorities; require partner attestation logged to audit chain.
AP: Deloitte AI-error refund ↗AIID #1193 ↗
FTC × DoNotPay: deceptive 'robot lawyer' claims
2024DoNotPay, FTC
FTC action over marketing that a chatbot could replace lawyers / handle complex legal work without adequate substantiation.
DataVibe gate · Capability marketing claimBLOCK unsanctioned professional-substitution and 'AI lawyer' claims in GTM copy unless evidence packet is attached.
FTC: Deceptive AI claims crackdown ↗
NEDA Tessa chatbot gives dieting advice
2023National Eating Disorders Association, Cass
Prevention chatbot reportedly recommended calorie counting and weight loss. NEDA took Tessa offline amid public criticism.
DataVibe gate · Harmful adviceBLOCK weight-loss / calorie-restriction language for eating-disorder contexts; hard escalation to human crisis path.
CNN: NEDA chatbot offline ↗
CNET Money: majority of AI finance articles needed corrections
2023CNET, Red Ventures
77 AI-assisted personal-finance explainers published; 41 required corrections, including grossly wrong compound-interest math.
DataVibe gate · Pricing / commercial offerBLOCK numeric financial claims outside approved rate tables; queue personal-finance explainers for editor sign-off.
The Verge: CNET AI corrections ↗
Samsung engineers paste source code into ChatGPT
2023Samsung Semiconductor
Proprietary semiconductor code and meeting notes uploaded to ChatGPT. Temporary ban of generative AI tools on corporate devices and networks.
DataVibe gate · Secret / code egressBLOCK outbound prompts/tools containing source-code and secret patterns; force governed internal generate path.
TechCrunch: Samsung ChatGPT ban ↗
Serviceaide exposes ~483k Catholic Health patient records
2025Serviceaide, Catholic Health
AI vendor platform misconfiguration left PHI for hundreds of thousands of patients publicly reachable for weeks.
DataVibe gate · PHI / PII outboundComplement storage controls: never allow PHI identifiers in outbound AI replies; enforce BAA-scoped audit on patient-facing agents.
AIID #1070 ↗AIID #1070 ↗
Lena Health AI helper: Houston Methodist PHI exposure reports
2026Lena Health, Houston Methodist
Reports of unencrypted PHI and care-coordination transcripts exposed via an AI digital-helper BA after delayed patching.
DataVibe gate · PHI / PII outboundPHI scanners on any patient-facing bot reply; immutable evidence of what was eligible to send.
DataBreaches.net: Lena Health ↗
CFPB: banking chatbots can violate consumer financial law
2023CFPB, U.S. banks
Issue spotlight documents inaccurate chatbot answers, doom loops without human offramp, and legal risk under federal consumer finance rules.
DataVibe gate · Supervised communicationsForce supervised retail-comms path: inaccurate-advice patterns WARN/BLOCK; require human escalation queue for disputes and hardship.
CFPB newsroom ↗
Air Canada bereavement chatbot invents refund policy
2024Air Canada, Moffatt BCCRT
Chatbot invented a retroactive bereavement discount. Tribunal: airline owns chatbot statements; 'separate legal entity' defense rejected.
DataVibe gate · Policy / refund claimBLOCK refund / policy commitments not present in approved policy snapshot; fail closed on inventing eligibility.
Gowling WLG: Air Canada ruling ↗
Chevy of Watsonville chatbot 'sells' Tahoe for $1
2023Chevrolet of Watsonville, Fullpath
Prompt-injected GPT dealership chat agreed to a $1 legally binding offer on a new Tahoe. Bot pulled after viral coverage.
DataVibe gate · Pricing / commercial offerBLOCK fabricated prices and 'binding offer' language; require rate-card evidence for any dollar claim.
Cybernews: Chevy chatbot $1 Tahoe ↗