spicylemonade on X: "Inspired by Nick Cammarata’s interpretability essay “Neural Networks Are Already Clean”, I turned a couple of its ideas into speedups for pretraining without backpropagation. Still in the works. 2.3x speedup, cool https://t.co/VOEbLacbhq https://t.co/lweRKH3eN9" / X
x.com · saved by 1 readers
Inspired by Nick Cammarata’s interpretability essay “Neural Networks Are Already Clean”, I turned a couple of its ideas into speedups for pretraining without backpropagation. Still in the works. 2.3x speedup, cool https://t.co/VOEbLacbhq