[2305.15047] Ghostbuster: Detecting Text Ghostwritten by Large Language Models
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack
View PDF HTML (experimental) Abstract:We introduce Ghostbuster, a state-of-the-art system for detecting AI-generated text. Our method works by passing documents through a series of weaker language models, running a structured search over possible combinations of their features, and then training a classifier on the selected features to predict whether documents are AI-generated. Crucially, Ghostbuster does not require access to token probabilities from the target model, making it useful for detecting text generated by black-box models or unknown model versions. In conjunction with our…
saved by
related reading
- Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textarxiv.org
- [2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingarxiv.org
- [2406.11717] Refusal in Language Models Is Mediated by a Single Directionarxiv.org
- Predicting Empirical AI Research Outcomes with Language Modelsarxiv.org
- StoryScope: Investigating idiosyncrasies in AI fictionarxiv.org
- LLM Post-Training: A Deep Dive into Reasoning Large Language Modelsarxiv.org
- 2212.03827arxiv.org
- Learning Chess With Language Models and Transformersarxiv.org
- Chain of Draft: Thinking Faster by Writing Lessarxiv.org
- [2602.22755] AuditBench: Evaluating Alignment Auditing Techniques on Models with Hidden Behaviorsarxiv.org
- [2305.14251] FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationarxiv.org
- Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Modelsarxiv.org