[2602.04899] Phantom Transfer: Data-level Defences are Insufficient Against Data Poisoning
Abstract:We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal learning to work in real-world contexts and demonstrate that the attack works across models, including GPT-4.1. Indeed, even fully paraphrasing every sample in the dataset using a different model does not stop the attack. We also discuss connections to steering vectors and show that one can plant password-triggered behaviours into models while still beating defences. This suggests that data-level defences are insufficient for stopping sophisticated data poisoning attacks. We suggest that future work should focus on model audits and white-box security methods.
# link_2bpnf09t2w4.pdf ## Metadata - PDFFormatVersion=1.7 - IsLinearized=false - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - Author=Andrew Draganov; Tolga H. Dur; Anandmayi Bhongade; Mary Phuong - Creator=arXiv GenPDF (tex2pdf:a6404ea) - Custom.DOI=https://doi.org/10.48550/arXiv.2602.04899 - Custom.License=http://creativecommons.org/licenses/by/4.0/ - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.141592653-2.6-1.40.28 (TeX Live 2025) kpathsea version 6.4.1 - Custom.arXivID=https://arxiv.org/abs/2602.04899v2 - Producer=pikepdf 8.15.1
saved by
related reading
- Phantom Transfer and the Basic Science of Data Poisoning — LessWronglesswrong.com
- [2606.04929] Sequential Data Poisoning in LLM Post-Trainingarxiv.org
- A small number of samples can poison LLMs of any size \ Anthropicanthropic.com
- [2606.00831] Subliminal Learning is a LoRA Artifactarxiv.org
- Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samplesarxiv.org
- Why Do Naive SFT Filters For Safety Properties Fail? — AI Alignment Forumalignmentforum.org
- Subliminal Learning: Language Models Transmit Behavioral Traits via Hidden Signals in Dataalignment.anthropic.com
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- secret-loyalties-whitepaper.pdfformationresearch.com
- [2510.27062] Consistency Training Helps Stop Sycophancy and Jailbreaksarxiv.org
- [2502.17424] Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMsarxiv.org
- 2408.12798arxiv.org