✳flâneur — a map of the web's best reading

[2604.22082] Removing Sandbagging in LLMs by Training with Weak Supervision

arxiv.org · 702 words · saved by 1 readers

Abstract:As AI systems begin to automate complex tasks, supervision increasingly relies on weaker models or limited human oversight that cannot fully verify output quality. A model more capable than its supervisors could exploit this gap through sandbagging, producing work that appears acceptable but falls short of its true abilities. Can training elicit a model's best work even without reliable verification? We study this using model organisms trained to sandbag, testing elicitation techniques on problem-solving math, graduate-level science, and competitive coding tasks. We find that training with weak supervision can reliably elicit sandbagging models when supervised fine-tuning (SFT) and reinforcement learning (RL) are combined: SFT on weak demonstrations breaks the sandbagging behavior, enabling RL to then fully elicit performance. Neither method succeeds reliably alone-RL without SFT almost always leads to reward hacking rather than genuine improvement. Critically, this relies on training being indistinguishable from deployment; when models can distinguish between training and deployment, they can perform well during training while continuing to sandbag afterward. Our results provide initial evidence that training is a viable mitigation against sandbagging, while highlighting the importance of making training indistinguishable from deployment.

[2604.22082] Removing Sandbagging in LLMs by Training with Weak Supervision --> Computer Science > Machine Learning arXiv:2604.22082 (cs) [Submitted on 23 Apr 2026 ( v1 ), last revised 1 May 2026 (this version, v2)] Title: Removing Sandbagging in LLMs by Training with Weak Supervision Authors: Emil Ryd , Henning Bartsch , Julian Stastny , Joe Benton , Vivek Hebbar View a PDF of the paper titled Removing Sandbagging in LLMs by Training with Weak Supervision, by Emil Ryd and 4 other authors View PDF HTML (experimental) Abstract: As AI systems begin to automate complex tasks, supervision increasi

Explore this link on the map →

saved by

related reading