Project Zero: From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code
googleprojectzero.blogspot.com · 2,484 words · saved by 1 readers
Posted by the Big Sleep team Introduction In our previous post, Project Naptime: Evaluating Offensive Security Capabilities of Large L...
Posted by the Big Sleep team Introduction In our previous post, Project Naptime: Evaluating Offensive Security Capabilities of Large Language Models , we introduced our framework for large-language-model-assisted vulnerability research and demonstrated its potential by improving the state-of-the-art performance on Meta's CyberSecEval2 benchmarks. Since then, Naptime has evolved into Big Sleep, a collaboration between Google Project Zero and Google DeepMind. Today, we're excited to share the first real-world vulnerability discovered by the Big Sleep agent : an exploitable stack buffer underflow
related reading
- From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code - Project Zerogoogleprojectzero.blogspot.com
- Assessing Claude Mythos Preview’s cybersecurity capabilities \ Anthropicred.anthropic.com
- Vulnerability Research Is Cooked - Quarrelsomesockpuppet.org
- Measuring LLMs' impact on N-day exploits \ Anthropicred.anthropic.com
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectionarxiv.org
- Security incident disclosure — July 2026huggingface.co
- [2502.17424] Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMsarxiv.org
- [2312.06942] AI Control: Improving Safety Despite Intentional Subversionarxiv.org
- [2608.09867] Stealing Reasoning Traces from Proprietary LLM APIsarxiv.org
- [2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingarxiv.org
- AI for Program Reasoningai4pr.github.io
- [2602.14689] Exposing the Systematic Vulnerability of Open-Weight Models to Prefill Attacksarxiv.org