The Myth of unsafe Open Source AI
florianbrand.com · 1,146 words · saved by 1 readers
Thoughts about open and closed AI
The Myth of unsafe Open Source AI The Myth of unsafe Open Source AI Researchers, often working at closed labs, argue that open models are inherently unsafe because you cannot control them after their release, and because they can be fine-tuned for any malicious use case. While this argument is theoretically true, it also assumes that closed models are safer, that their guardrails work, and that their providers take measures against misuse. Therefore, I went ahead and researched the misuse of both open and closed models and compiled a list. For this, I looked into third-party reports examining
saved by
related reading
- Building Auto Mode for Open Models — Benjamin Andersonbenanderson.work
- Countering misuse of AI: September 2026 / Anthropicanthropic.com
- An alignment assessment of recent cybersecurity incidentsanthropic.com
- Claude Fable 5 and Claude Mythos 5 \ Anthropicanthropic.com
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- A Safe Path to Open Weights - Thinking Machines Labthinkingmachines.ai
- Why open-weight models without guardrails are a AI safety risk : NPRnpr.org
- Security incident disclosure — July 2026huggingface.co
- Claude Mythos Preview System Cardwww-cdn.anthropic.com
- OpenAI – Hugging Face Incident Technical Reportcdn.openai.com
- Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — LessWronglesswrong.com
- GPT-5.5 and the broken state of government evalstransformernews.ai