flâneur

The Bitter Lesson – Yuxi on the Wired

yuxi-liu-wired.github.io · 2,263 words · saved by 1 readers

Only search and learning scales arbitrarily.

The Bitter Lesson – Yuxi on the Wired The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore’s law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research pr

related reading