Language Models are Elastic

N/A

Language Models Resist Alignment: Evidence From Data Compression Jiaming Ji* , Kaile Wang* , Tianyi Qiu* , Boyuan Chen* , Jiayi Zhou* Changye Li, Hantao Lou, Juntao Dai, Yunhuai Liu, Yaodong Yang† Institute for Artificial Intelligence, Peking University Abstract Our Contribution: The Elasticity of LLMs Language models, fine-tuned with perturbations, exhibit an Large…

saved by

• Arya Pasumarthi

related reading

• [2602.15799] The Geometry of Alignment Collapse: When Fine-Tuning Breaks Safetyarxiv.org
• [2309.10668] Language Modeling Is Compressionarxiv.org
• Compression and Intelligencegreene.sh
• [2502.17424] Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMsarxiv.org
• Large Language Diffusion Modelsarxiv.org
• Self-Adapting Language Modelsarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• Position: It's Time to Optimize for Self-Consistencytime-for-consistency.github.io
• Language Model Compositionarxiv.org
• [2602.05970] Inverse Depth Scaling From Most Layers Being Similararxiv.org
• LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelsarxiv.org
• [2509.14786] Pre-training under infinite computearxiv.org