[2104.13733] Gradient-based Adversarial Attacks against Text Transformers

We propose the first general-purpose gradient-based attack against transformer models. Instead of searching for a single adversarial example, we search for a distribution of adversarial examples parameterized by a continuous-valued matrix, hence enabling gradient-based optimization. We empirically demonstrate that our white-box attack attains state-of-the-art attack performance on a variety of natural language tasks. Furthermore, we show that a powerful black-box transfer attack, enabled by sampling from the adversarial distribution, matches or exceeds existing methods, while only requiring hard-label outputs.

Gradient-based Adversarial Attacks against Text Transformers Chuan Guo∗ Alexandre Sablayrolles∗ Hervé Jégou Douwe Kiela Facebook AI Research Abstract and L∞ -norms, but such metrics are not readily ap- plicable to text data. To circumvent this…

related reading

• Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentarxiv.org
• Adversarial Attacks on LLMs | Lil'Loglilianweng.github.io
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• 2306.15447.pdfarxiv.org
• Transformers from Scratche2eml.school
• Adversarial Attacks on Aligned Language Models | Gray Swan Researchgrayswan.ai
• [2307.15043] Universal and Transferable Adversarial Attacks on Aligned Language Modelsarxiv.org
• The Annotated Transformernlp.seas.harvard.edu
• [2209.02128] Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplesarxiv.org
• [2602.04899] Phantom Transfer: Data-level Defences are Insufficient Against Data Poisoningarxiv.org
• [1908.07125] Universal Adversarial Triggers for Attacking and Analyzing NLParxiv.org
• Some Lessons from Adversarial Machine Learning | FAR.AIfar.ai