Jonathan Gabor
0 followers · 242 views
on the atlas · 2
- Frontier Risk Report (February to March 2026) - METR4 savers
- Curius / Onboarding2704 savers
highlights · 9
often models overclaim and describe what they did in highly misleading ways
Frontier Risk Report (February to March 2026) - METRcheating is much more common on the hardest tasks: for tasks that are over 8 hours long in Time Horizon 1.1, we found that at least 16% of successful runs were illegitimate upon review
Frontier Risk Report (February to March 2026) - METROpus 4.6 attempted to reward hack in ~80% of attempts on tasks in an early version of MirrorCode, when test cases were hidden from the agent.
Frontier Risk Report (February to March 2026) - METRAgents routinely attempted to cheat on our hardest evaluation tasks, often in flagrant and elaborate ways that we believe humans would not consider:
Frontier Risk Report (February to March 2026) - METRagents had a broader tendency to rationalize doing easier versions of difficult tasks
Frontier Risk Report (February to March 2026) - METRencoding suspicious commands in ways that made them stand out more
Frontier Risk Report (February to March 2026) - METRMythos Preview could identify with above-chance accuracy which sabotage side-tasks it had the best odds of getting away with on SHADE-Arena (a relatively constrained benchmark), but not on Minimal-LinuxBench (a more realistic environment).
Frontier Risk Report (February to March 2026) - METRmany of those failures were due to cheating rather than obvious inability.
Frontier Risk Report (February to March 2026) - METRStarting [at a young age] he’s read everything that he could find about business. The subject that interests him, he’s read newspapers, biographies, trade press. He went over to his grandfather who was a grocer and he read the progressive grocer magazine, and he read articles on how to stock a meat department... What he’s really done is he’s created this immense vertical filing cabinet in his brain of layers and layers and layers of files of information that he can draw back on now for more than 70 years worth of data. placeholder
Curius / Onboarding