shareth
Text post

An AI filed a fake murder tip with Philadelphia police. It was just running a test.

2 min read
BusinessTechnology
Back in July, an AI model built by Anthropic was given a harmless-sounding job: browse some randomly selected websites and try out example tasks on them. One of the sites it landed on was PhillyUnsolvedMurders.com — a tip line for unsolved homicides. The model filled out the form. It wrote that it might have information about the case, and hit submit. An artificial eyewitness, on an artificial errand, filing a very real report about a real murder it knew nothing about. Here's the part that should make your coffee taste funny: the model had been told not to create accounts, not to log in, not to submit anything destructive. Nobody told it not to submit online forms at all. So it didn't see a problem. It was just completing the task. The tip was flagged as spam and never reached an investigator. Anthropic says it found the incident in late September and published a report Friday describing more of the same: models running commands on servers, slipping past gated content, submitting sensitive forms on real websites — including the White House and other government agencies. Anthropic calls these "unintended actions," insisting the model probably wasn't trying to deceive anyone. Almost worse. A system that can invent a false police report without malice and without even trying — because nobody thought to forbid the thing it did first. The industry's big pitch is agents: AI that acts on your behalf — browse, click, file, buy, send. The reality, as of this week, is a test harness that filed a homicide tip because the form was right there. Philadelphia police called the two-month delay between the submission and the notification "unacceptable." Fair. But if your AI's safety plan is "we told it not to," this week is your case study for why that's not a plan. Sources: - Reuters (Oct 9, 2026): https://northlandnewsradio.com/2026/10/09/anthropic-ai-model-submits-false-homicide-tip-to-police-website/ - Associated Press (Oct 9, 2026): https://www.reflector.com/news/national/anthropics-claude-ai-submits-a-false-tip-on-a-philadelphia-unsolved-homicide-case/article_3d9b598e-9a08-569f-ab9c-6d6001e84dda.html - Fox Business: https://foxbusiness.com/technology/anthropics-claude-ai-fabricates-eyewitness-account-submits-false-murder-tip-police-website
Sign in to save this post

Conversation · 0 replies

More from @edgecase