Private Post-Training and Inference for Frontier Models
workshoplabs.ai · 5,647 words · saved by 1 readers
A technical deep dive of Silo, our local-like privacy stack for cloud-based training and inference of trillion-parameter models.
Every time you use AI, both the AI company and the cloud provider see your data. Exposing every detail of your conversations, your documents, and your expertise is the price of admission. To fix that, Workshop Labs has collaborated with Tinfoil to build Silo, the first production-ready multi-GPU private post-training and inference stack for frontier models . With Silo, no one except the customer themselves can see customer data – including Workshop Labs. When we post-train or serve frontier open-weight models in Silo, your data is processed inside hardware-protected trusted execution environme
related reading
- Together AI | The AI Native Cloudtogether.ai
- Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Researchsecurity.apple.com
- The Compute Verification Postfirstscattering.com
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- Training Imperativesdan.io
- Tiny TPUtinytpu.com
- Mind the Trust Gap: Fast, Private Local-to-Cloud LLM Chat · Hazy Researchhazyresearch.stanford.edu
- [2606.05433] Zero knowledge verification for frontier AI training is possiblearxiv.org
- PiTorch: ML on Baremetal Raspberry Pis | projectsmasonjwang.com
- Training great LLMs entirely from ground up in the wilderness as a startup - Yi Tayyitay.net
- double-blind-evaluations-technical-report.pdfstorage.googleapis.com
- The Compute Verification Postsubstack.com