AVERI Pilot Report: The World’s First Double-Blind Evaluation of a Proprietary Language Model — AVERI
This post is part of AVERI's pilot report series. AVERI runs pilot projects with leading AI companies and converts what we learn into auditing standards, policy analysis, and open source tools. This post summarizes AVERI’s involvement in a project conducted in collaboration with Google DeepMind, Ope
This post is part of AVERI's pilot report series. AVERI runs pilot projects with leading AI companies and converts what we learn into auditing standards, policy analysis, and open source tools. This post summarizes AVERI’s involvement in a project conducted in collaboration with Google DeepMind, OpenMined, and MLCommons. At AVERI (the AI Verification and Evaluation Research Institute), our mission is to make frontier AI auditing effective and universal. Frontier AI auditing means third-party verification of leading AI developers' safety and security claims, and evaluation of their systems…
saved by
related reading
- double-blind-evaluations-technical-report.pdfstorage.googleapis.com
- Privacy-Preserving AI Audit Tools — OpenMinedopenmined.org
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- A Summary of Recent Work (July 2026)gdmalignment.substack.com
- Frontier Risk Report (February to March 2026) - METRmetr.org
- Auditing language models for hidden objectives \ Anthropicanthropic.com
- Auditing language models for hidden objectives — LessWronglesswrong.com
- The Compute Verification Postfirstscattering.com
- User awareness in frontier modelstransluce.org
- AI Integrity: Defending Against Backdoors and Secret Loyalties - Institute for AI Policy and Strategyiaps.ai
- AINews | AINewsnews.smol.ai
- [2606.05433] Zero knowledge verification for frontier AI training is possiblearxiv.org