Could decentralized training solve AI’s power problem? | Epoch AI
epoch.ai · saved by 1 readers
We illustrate a decentralized 10 GW training run across a dozen sites spanning thousands of kilometers. Developers are likely to scale data centers to multi-gigawatt levels before adopting decentralized training.