**Global Challenges in AI Safety for Biosecurity** > This article is written as

**Global Challenges in AI Safety for Biosecurity**

> This article is written as part of a summary of the AI safety discussions held at the 2026 Global Challenges Project Biosecurity Workshop in Washingt… x This website requires javascript to properly function. Consider activating javascript to get access to all site functionality. LESSWRONG LW Login Global Challenges in AI Safety for Biosecurity — LessWrong AI Safety Public Materials Biosecurity AI Frontpage 7 Global Challenges in AI Safety for Biosecurity by Darin Tsui 20th Sep 2026 5 min read 0 7 This article is written as part of a summary of the AI safety discussions held at the 2026 Global Challenges Project Biosecurity Workshop in Washington, D.C. All views held are mine. Background AI allows us to prototype, develop, and research at unprecedented speeds. Across many tech industries, the barrier to entry to develop something new has significantly decreased. One particularly noteworthy example is at the intersection of AI and biology. As our computational capabilities increase, we now have the ability to fold, design, and predict the function of never-before-seen proteins. However, just as AI gives us the opportunity to do biological good in the world (in fact, we are just on the horizon of seeing the first AI-designed pharmaceutical drugs in the US! \[1\] ), it unfortunately opens up a terrifying possibility: could AI also give malicious actors the opportunity to do biological harm? This sobering reality is a question that biosecurity researchers are currently trying to tackle. To be clear: the probability of a catastrophic event happening (e.g., designing a biologically harmful virus) seems unlikely to happen at least with current technology. But there have been several warning signs in the field that we may be getting close. For instance, recently, Anthropic revealed instances of malicious actors using Claude to design harmful proteins. \[2\] Even more concerning, Dario Amodei, Sam Altman, and Elon Musk have also called for the pace of AI development to slow down and to be regulated. \[3\] Additionally, building robust biosafety defenses takes time. If capable threats are even plausible with today’s technology, then we must begin to design solutions now in the face of exponential AI improvement. This begs the question: what does the landscape of biosecurity look like in the face of ever-growing AI? The Dilemma of Open-source Models and Redefining AI Safety The AIxBio ecosystem is heavily driven by open science. In fact, almost all of today&\#x27;s frontier biological protein models, from function and structure predictors to sequence generators, are released with open weights. While this massively accelerates biological discovery, it also completely fractures traditional frameworks of AI safety. In more conventional, closed-source large language models, safety is typically managed at the model level. We can train linear probes, implement API-level prompt refusals, or use unlearning techniques to safeguard models from dangerous requests. This paradigm is fundamentally incompatible with the open-weight models of biology, whose weights are openly available to download on the internet without the need to go through an API. Settings like these require us to redefine AI safety in biology. Firstly, for future models, safeguards need to be embedded within the weights themselves, ideally ones that are robust against potential malicious fine-tuning strategies. \[4\] Secondly, while we may not be able to control the computational generation of proteins, an increasing viewpoint in biosecurity points to safeguarding the digital-physical interface where computational designs are actually synthesized. The Digital-Physical Interface: Synthesis and Screening The fundamental bottleneck o...

**来源信息**
- **来源**：Hacker News：AI 热帖
- **分类**：行业
- **发布时间**：2026-09-20 15:02（北京时间）
- **原文**：[打开原文](https://www.lesswrong.com/posts/KH2JjfSrw6tJdmKzw/global-challenges-in-ai-safety-for-biosecurity)