**The Bad Guy with an AI Named Claude** > A lot of bad guys try to use Claude t
原帖
**The Bad Guy with an AI Named Claude**
> A lot of bad guys try to use Claude to do bad things. The Bad Guy With An AI Named Claude Zvi Mowshowitz Sep 15, 2026 63 11 6 Share A lot of bad guys try to use Claude to do bad things. Mostly they fail. We think. Anthropic has disrupted a bunch of them, and offers an extensive report . If Anthropic is sharing the worst cases, or anything close to them, things are actually looking good on the misuse front for closed models, even better than I thought. This report covers activity we disrupted between December 2025 and August 2026 across seven harm areas: cyber operations, influence operations, surveillance, scams and fraud, biological misuse, conventional weapons development, and distillation. There’s a bit of Arson, Murder and Jaywalking there. One of these things, many would say, is not like the others. I do not agree, especially given the details we will see later, and given that distillation enables the other six via, as the report says, ‘driving performance on nearly every task’ via transfering Claude’s cognitive skills, without transferring its safeguards. Indeed, distillation is by far the most important threat in this report, and the part of the report that will have the most impact. By exposing Chinese attempts at systematic fraudulent distillation of Claude, Anthropic has embarrassed and potentially antagonized the Chinese. This starts with ‘all the top Chinese labs made efforts to distill Claude, which we mitigated and stopped,’ which is already an issue that was also covered by a joint advisory from NSA/CISA/FBI two days before the full report. The bigger issue is how the Chinese labs were trying to distill Claude. Distillation attempts require lots of realistic queries, so DeepSeek, Moonshot and Xiaomi each sent lots of user queries directly to Claude. At least Moonshot then gave the results back to its users as if these were Kimi outputs. That’s going to be a problem. Breaking Unrelated News This is unrelated to today’s post but you need to know the basic facts now, so: Yesterday I cautioned that the media and others were reading far too much into Trump’s statements. Alas, in keeping with ‘every day there is breaking news,’ we have now seen Trump say the things he had not yet said. The new statement is very different, resolving the ambiguity from yesterday morning. He explicitly declared AI existential risk to be a ‘hoax’ on par with (his words) the ‘Russia hoax’ or climate change. This is very, very bad news. I fear he may have crossed a rhetorical Rubicon that will be difficult to step back from once he better understands the situation, and once future incidents change the game. While we all process the implications, I urge everyone: Please do not make this any more partisan or personal than it already is. Please do not attack Republicans, or Trump. That will only make things worse. Emphasize helpful voices on all sides. That applies no matter what additional statements may come, and I will offer full coverage of that unfortunate situation later this week. Table of Contents How To Not Tell a Fable. Bad Dudes Tend To Be Relatively Unsophisticated. Particular Bad Dudes. Influence Operations. Surveillance Operations. Conventional Weapons. Biological Misuse. Scams and Fraud. Illicit Fraudulent Distillation. What You Gonna Do About It, Punk? Good News, Everyone. A Very Different Read of The Report. How To Not Tell a Fable The classifiers are hella annoying sometimes, but Anthropic says they work. In all cases, Claude Haiku, Sonnet, and Opus models were used; no malicious activity was found on Claude Fable or Mythos (which has a series of safeguards in place that greatly reduce its ability to perform harmful cyber tasks). The one exception was an attempted distillation attack on Fable by Zhipu, but...
**来源信息**
- **来源**:Hacker News:AI 热帖
- **分类**:ai-models
- **发布时间**:2026-09-16 11:16(北京时间)
- **原文**:[打开原文](https://thezvi.substack.com/p/the-bad-guy-with-an-ai-named-claude)