flâneur

Private Post-Training and Inference for Frontier Models

workshoplabs.ai · 5,647 words · saved by 1 readers

A technical deep dive of Silo, our local-like privacy stack for cloud-based training and inference of trillion-parameter models.

Every time you use AI, both the AI company and the cloud provider see your data. Exposing every detail of your conversations, your documents, and your expertise is the price of admission. To fix that, Workshop Labs has collaborated with Tinfoil to build Silo, the first production-ready multi-GPU private post-training and inference stack for frontier models . With Silo, no one except the customer themselves can see customer data – including Workshop Labs. When we post-train or serve frontier open-weight models in Silo, your data is processed inside hardware-protected trusted execution environme

related reading