AuditAgent
AuditAgent on EVMBench: 40 Repositories, 120 Vulnerabilities, No Repos SkippedAuditAgent detected 80 of 120 high-severity vulnerabilities on EVMBench. 40 repositories, run in order, no repos skipped. Full results and methodology.
AuditAgent Back to Blog AuditAgent on EVMBench: 40 Repositories, 120 Vulnerabilities, No Repos Skipped April 7, 2026 Most AI security tools do not publish standardized benchmark results. Standardized benchmarks produce numbers that can be compared, and comparisons require confidence in methodology. EVMBench is one of the first standardized benchmark for AI vulnerability detection on smart contracts, built by OpenAI and Paradigm. We ran AuditAgent across all 40 repositories. Here is what it shows, how it was run, and what the numbers mean. What Is EVMBench and What Does It Measure EVMBench cove
Explore this link on the map →saved by
related reading
- EVMBench Leaderboard — AI Smart Contract Auditorstestmachine.ai
- Center for Responsible, Decentralized Intelligence at Berkeleyrdi.berkeley.edu
- Measuring LLMs’ ability to develop exploits \ Anthropicred.anthropic.com
- Assessing Claude Mythos Preview’s cybersecurity capabilities \ Anthropicred.anthropic.com
- Mythos finds a curl vulnerability | daniel.haxx.sedaniel.haxx.se
- Demystifying evals for AI agents \ Anthropicanthropic.com
- Security incident disclosure — July 2026huggingface.co
- AI agents find smart contract exploits \ Anthropicred.anthropic.com
- Vulnerability Research Is Cooked - Quarrelsomesockpuppet.org
- AuditBenchalignment.anthropic.com
- A shallow dive into formal verificationvitalik.eth.limo
- [2312.12575] LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarksarxiv.org