The Hardest Part of Shrinking a Robotics Model | Haptic Labs

hapticlabs.ai · 2,441 words · saved by 1 readers

Shrinking Pi0.5 by 2.9× on disk and 2.8× faster. The paper gives you the recipe; the pipeline tax is what makes it hard in production.

Your browser does not support the video tag. LIBERO-Spatial task 0, side by side: Pi0.5 FT teacher (4.14 B params, 8.3 GB) on the left, V8-trim + INT8 student (2.31 B params, 2.85 GB) on the right. Same task, ~3× smaller model. Shrinking Pi0.5 by 2.9× on disk and 2.8× faster. The paper gives you the recipe. We're sharing what it costs to actually run that recipe end-to-end. TL;DR Shrinking robotics models makes them faster and lets them run on cheaper, lower-power hardware. We shrank Pi0.5 using two techniques: layer pruning and INT8 quantization . End result: 3.0× smaller in memory, 2.9× smal

The Hardest Part of Shrinking a Robotics Model | Haptic Labs

related reading