Autonomous AI systems that make consequential decisions at scale — insurance coverage, hiring, search answers — can embed and amplify bias without a single human reviewing individual outputs. The legal and reputational exposure arrives months after the model ships.
UnitedHealth Group
2025 · CriticalUnitedHealth faced massive federal class-action lawsuits after its black-box predictive AI algorithm (nH Predict) was found to be automatically and systematically denying critical post-acute care claims, overriding human doctors' recommendations to optimize corporate profit margins. A court later ordered UnitedHealth to disclose the algorithm.
⚠Federal class-action suits · Congressional investigation · court-ordered algorithm disclosure
DistilInfo — Court Orders UnitedHealth Algorithm Disclosure →
Workday AI Hiring Platform
2025 · CriticalWorkday's autonomous resume-filtering AI was hit with class-action legal exposure after audits revealed its proprietary machine learning templates disproportionately and systematically filtered out applicants who were older, Black, or disabled — with no human review layer. A federal judge allowed the age discrimination claims under ADEA to proceed in early 2026.
⚠Class-action lawsuit · EEOC scrutiny · ADEA age discrimination claims survive dismissal in 2026
Seyfarth — Mobley v. Workday Ruling →
Google AI Overviews
2024 · HighUpon launching its generative search feature, Google's autonomous extraction engine scraped satirical Reddit threads and served the results as factual advice to millions of users — including recommending Elmer's glue in pizza sauce to keep cheese from sliding off, and suggesting people eat rocks for vitamins.
⚠Viral PR crisis · feature roll-back · trust damage at search-engine scale
EvidentlyAI — Google AI Overviews Fail →
King Features Syndicate
2025 · MediumA syndicated book-review AI autonomously generated an entire printed newspaper insert featuring real, named authors — but attributed completely hallucinated, non-existent book titles to them. King Features immediately terminated its relationship with the operator for violating editorial standards.
⚠Vendor contract terminated · defamation exposure to named authors
Medium — King Features AI Hallucination →
iTutorGroup — EEOC Age Discrimination
2023 · CriticalThe EEOC's first-ever AI hiring discrimination enforcement action found that iTutorGroup's automated recruiting software systematically rejected female applicants aged 55+ and male applicants aged 60+. The bias was discovered when a rejected applicant resubmitted an identical résumé with only the birth year changed — and received an interview invitation.
⚠$365,000 settlement · 200+ rejected applicants compensated · 5-year EEOC compliance monitoring
EEOC.gov — iTutorGroup Settlement →
Intuit / HireVue — ACLU Bias Complaint
2025 · HighThe ACLU filed a federal complaint alleging HireVue's AI video-interview platform, deployed by Intuit for seasonal hiring, discriminated against a deaf Indigenous woman. She requested human captioning and was denied; the AI evaluated her speech and she was rejected with feedback telling her to 'practice active listening.' Researchers also found the system likely performs worse on non-white English dialects including Native American English.
⚠EEOC and Colorado Civil Rights Division complaints filed · ADA, Title VII, and CADA violations alleged
Public Justice — Intuit/HireVue Bias Complaint →
Humana — nH Predict Medicare Claim Denials
2025 · CriticalHumana deployed the nH Predict AI to determine post-acute care coverage for Medicare Advantage patients. A class-action lawsuit alleged the algorithm overrode doctors' clinical recommendations at scale, had a documented high error rate, disciplined employees who contradicted its outputs, and denied patients access to the reasoning behind denials — making appeals nearly impossible. A Senate subcommittee found MA claim denials surged 40% during the AI's rollout period.
⚠Class-action lawsuit · federal court denied dismissal · Senate subcommittee investigation
Healthcare Dive — Humana Algorithm Lawsuit →
Amazon AI Recruiting Tool
2018 · CriticalAmazon's internal AI hiring system, trained on a decade of résumés from a male-dominated tech industry, developed a systematic preference for male candidates. It actively penalized résumés containing the word 'women's' and downgraded graduates of all-women colleges. Amazon quietly scrapped the project after engineers could not guarantee the model would not rediscover gender bias via other signals. The case became the foundational precedent for AI hiring auditing requirements.
⚠Tool scrapped · hundreds of female applicants systematically downranked · catalyzed global AI hiring audit regulation
MIT Technology Review — Amazon Ditched AI Recruiting Tool →
SEC AI-Washing — Delphia & Global Predictions
2024 · HighThe SEC's first-ever AI fraud enforcement actions charged two investment advisers with falsely claiming their AI managed client portfolios. Delphia stated for four years that it used AI with client data in its investing algorithm; it never did. Global Predictions made fabricated AI capability claims on its website and social media. Both firms settled without admitting wrongdoing.
⚠$400,000 total civil penalties · first-ever SEC AI fraud enforcement · signals sustained AI-washing crackdown
SEC.gov — AI-Washing Enforcement Press Release →