✳flâneur — a map of the web's best reading

HPC vs AI

glennklockwood.com · 853 words · saved by 1 readers

System architecture There are a few differences between designing a supercomputer for AI and designing a supercomputer for traditional modeling and simulation.

System architecture There are a few differences between designing a supercomputer for AI and designing a supercomputer for traditional modeling and simulation. I once gave a presentation internally at Microsoft that contained this table: The biggest differences amount to: AI benefits from multi-plane fat trees. They make collectives faster since more nodes can talk to each other without hopping through switches, but they require more nodes and switches to be connected together in a small space. In practice, this requires using expensive optics instead of DAC cables. AI uses a lot of node-local

Explore this link on the map →

saved by

related reading