artificial intelligence
The Bitter Lesson Was Right. Then the Sun Got Involved.
The bitter lesson was most true in 2019. It is slightly less true today. And it will be less true still in the future. Not because scaling stopped working. But because the assumptions underneath it are quietly falling apart