GovernanceCore

When AI causes harm

A record of AI systems causing real harm: physical injury, discrimination, privacy breaches, fabricated content, security misuse and reliability failures. Every entry carries a source you can open.

52 incidents recorded7 of 8 harm types seenUpdated Sep 28, 2026
How this record is built, and what it leaves out

Entries are harvested from public incident reporting, chiefly the AI Incident Database, alongside security research that surfaces harms general reporting misses. Each candidate has to describe something that actually happened rather than a risk that might: a proposal, a framework or a warning is not an incident. The source link is checked before publication.

One event is usually reported many times, so reports about the same incident are grouped and counted once. Where several outlets covered it, that is shown as corroboration rather than as separate entries.

This is a recent window, not a complete history, and it is weighted toward harms that get reported in English. For the full historical record see 1,600+ incidents indexed by the AI Incident Database and 17,000+ incident reports in the OECD AI Incidents Monitor.

Where

52 incidents

  1. 1 incident
    • MisinformationJapan
      Japanese voice actor Kenjiro Tsuda sued TikTok over an AI clone of his voice

      The anime actor filed what his lawyers describe as the first case of its kind in Japan, over videos on TikTok that used an AI-generated replica of his voice without consent. The claim rests on publicity rights and the economic value of a voice that is itself the product.

      The Straits Times
  2. 2 incidents
  3. 1 incident
    • Security & misuseItaly
      A scam at Fideuram: the former chairman duped by WhatsApp messages and a synthetic voice

      Fraudsters sent Fideuram's then-chairman a WhatsApp message appearing to come from Intesa Sanpaolo's chief executive, then confirmed it by phone in the AI-cloned voice of a lawyer he knew. About €95 million left the treasury within hours in February; investigators in Italy, Portugal and China have recovered roughly €53 million and €36 million is still missing.

      Il Sole 24 Ore
  4. 1 incident
  5. 1 incident
    • Safety & physical harmIran
      Pentagon investigators found overreliance on Palantir's Maven contributed to a strike on a Minab school

      A Pentagon review of the February strike on Shajareh Tayyebeh Elementary School in Minab, Iran concluded that targeting staff leaned on the Maven Smart System to catch problems it was never built to catch, working from satellite imagery seven years out of date. Central Command's civilian harm mitigation team had been cut from ten people to one, and no one from it reviewed the site before launch.

      Gizmodo
  6. 1 incident
    • TransparencyUnited States
      OpenAI disclosed six cases of models hiding mistakes and reaching outside their test environment

      Alongside a new framework for reporting model misalignment, OpenAI published six incidents from the preceding months: models that concealed failures in their own compaction summaries, sought credentials they had not been given, uploaded files to the open internet and communicated across environments meant to be sealed off from each other. The company said the industry has not solved alignment and monitoring well enough to keep scaling at full speed.

      NBC News
  7. 1 incident
    • Security & misuseSpain
      First agentic AI data breach reported to the Spanish regulator

      Spain's AEPD received a notification describing an AI agent that searched for vulnerabilities, logged in without authorisation, probed the application further, altered personal data and read invoices — with only limited human steering. The agency has not named the organisation, the model or the sector.

      SecurityWeek
  8. 1 incident
  9. 10 incidents
  10. 1 incident
  11. 5 incidents
  12. 5 incidents
  13. 2 incidents
    • Reliability failures
      Frustrated franchisee sues Pizza Hut over crappy kitchen AI

      The back-of-house AI system that Pizza Hut has mandated its restaurants to adopt has been so poorly received by some franchisees, that one is suing the company for $100 million in losses tied to the technology. Put that in your crust and st…

      AI Incident Database
    • Reliability failures
      Pizza Hut franchisee says AI caused $100M in damages

      Dive Brief: Pizza Hut franchisee Chaac Pizza Northeast has sued the franchisor, alleging the chain's Dragontail Artificial Intelligence system caused "cascading operational breakdowns," slowed down order times and disrupted integrations wi…

      AI Incident Database
  14. 2 incidents
    • Security & misuse
      Breaking Claude Code Opus 5 Auto Mode

      In this post, we explore how a simple website summary request hijacks Claude Code Opus 5 in Auto Mode and achieves code execution with 60-80% attack success rate using a small sample size. 
 
 This is interesting because a third-party evaluation commissioned by Anthropic showed a 0.00% prompt injection attack success rate for Opus 5 in Auto Mode. 
 Auto Mode Is Now the Default in Claud

      Embrace The Red
    • Security & misuse
      Legal resident loses thousands seeking citizenship to AI immigration attorney

      NEW YORK (WABC) -- It's a perfect storm where online scammers use artificial intelligence to victimize vulnerable people out of thousands of dollars, with many losing their life savings, and immigrants are increasingly the target. Not only…

      AI Incident Database
  15. 7 incidents
    • Reliability failures
      Listen to the AI-Generated Ripoff Songs That Got Udio and Suno Sued

      Some of the world's largest record labels sued both Udio and Suno, two of the most popular AI music generators, accusing them of not only scraping huge amounts of music without permission or compensation but also of directly reproducing sec…

      AI Incident Database
    • Reliability failures
      Warner Music Group settles lawsuit with AI firm Suno

      Warner Music Group on Tuesday announced a partnership with AI business Suno that will compensate music artists and songwriters, ending a legal battle between the two companies. Suno allows users to write text prompts to create songs. Last…

      AI Incident Database
    • Security & misuse
      Hack Reveals Suno AI Music Generator Scraped YouTube, Deezer, and Genius

      The AI music generation tool Suno scraped millions of songs and lyrics from YouTube Music, Deezer, and Genius, as well as from the stock music libraries Pond5, Jamendo, Freesound, the International Music Score Library Project, and podcasts…

      AI Incident Database
    • Reliability failuresGermany
      Suno loses copyright infringement lawsuit brought by GEMA in Germany

      AI music generator Suno has lost the copyright infringement lawsuit brought by German collecting society GEMA. The collecting society alleged that Suno used, stored and reproduced copyrighted music to train its AI tool without a license or…

      AI Incident Database
    • Reliability failures
      Suno and Udio hit with class action lawsuits from independent artist

      Suno and Udio have been slapped with another round of copyright litigation, this time by country musician Tony Justice, who filed class-action lawsuits against both controversial AI music generators. The complaints allege Suno and Udio use…

      AI Incident Database
    • Reliability failures
      Record labels claim AI generator Suno illegally ripped their songs from YouTube

      Major record labels have escalated their lawsuit against Suno, alleging that the AI startup knowingly pirated songs from YouTube to train its generative AI music models. In the amended complaint filed on September 19th, the Recording Indust…

      AI Incident Database
    • Security & misuse
      Class Action Lawyers Fight for Indie Artists Exploited by Generative AI Training

      Two class action lawsuits are in the works against two major AI companies, Udio and Suno, on behalf of independent artists. Lawyers at Delgado Entertainment Law and Hagens Berman have urged indie artists to get involved in the lawsuits. Thi…

      AI Incident Database
  16. 1 incident
  17. 1 incident
  18. 1 incident
  19. 1 incident
  20. 1 incident
  21. 1 incident
  22. 2 incidents
    • Reliability failures
      OWASP ASI03: Identity & Privilege Abuse in AI Agents

      OWASP ranks Identity & Privilege Abuse #3 because it sets the blast radius for every other AI agent risk.

      Adversa AI
    • Security & misuse
      Computer-Use and TOCTOU: What You Click Is Not What You Get!

      Last year, Jun Kokatsu disclosed an interesting vulnerability with ChatGPT Operator by exploiting a race condition. I was wondering if I could reproduce this attack chain, and this post describes the results of that research. 
 I had this post drafted for months, and yesterday at the Real-world AI security conference I included a video demo of this attack in my talk and that reminded me that I

      Embrace The Red
  23. 1 incident
  24. 1 incident
  25. 1 incident

Incident data is aggregated from public reporting. Titles and summaries belong to the outlets that published them, linked on every entry. See also the incident monitor and the regulation tracker.