The 6D effect: When companies take risks, one email can be very powerful. — LessWrong
Recently, I have been learning about industry norms, legal discovery proceedings, and incentive structures related to companies building risky systems. I wanted to share some findings in this post because they may be important for the frontier AI community to understand well. Documented communications of risks (especially by employees) make companies much more likely to be held liable in court when bad things happen. The resulting Duty to Due Diligence from Discoverable Documentation of Dangers (the 6D effect) can make companies much more cautious if even a single email is sent to them communicating a risk. Companies often intentionally avoid discussing the risks of what they are doing through permanent media such as email. For example, this article gives some very shady advice on how companies can avoid liability by using “safe communication” practices to avoid the creation of incriminating “bad documents”. Often the drafters of these documents tend to believe that they are providing
x The 6D effect: When companies take risks, one email can be very powerful. — LessWrong AI Governance Incentives AI Risk Law and Legal systems World Optimization Curated 289 The 6D effect: When companies take risks, one email can be very powerful. by scasper 4th Nov 2023 3 min read 42 289 Recently, I have been learning about industry norms, legal discovery proceedings, and incentive structures related to companies building risky systems. I wanted to share some findings in this post because they may be important for the frontier AI community to understand well. TL;DR Documented communications o
Explore this link on the map →related reading
- Memossriramk.com
- The Kool Aid Factory :: Writing In Public, Inside Your Companykoolaidfactory.com
- Security incident disclosure — July 2026huggingface.co
- Responsible Scaling Policy v3 — LessWronglesswrong.com
- Ten people on the inside — LessWronglesswrong.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- The unwritten laws of software engineeringnewsletter.manager.dev
- rotorlab.tamu.edu/me489/README/2010 ASME Unwritten_Laws_of_Enginering.pdfrotorlab.tamu.edu
- Deep Research and Knowledge Value – Stratechery by Ben Thompsonstratechery.com
- Most Companies Wait Too Long to Declare Incidents | Brent Chapmangreatcircle.com
- Not a Paper: "Frontier Lab CEOs are Capable of In-Context Scheming" — LessWronglesswrong.com
- My Clients, The Liars — LessWronglesswrong.com