"Is it Bitter Lesson-pilled?" | Rich Sutton, Oak Lab
Bitter Lesson means scale computation via search and learning, not human knowledge injection
“don't be distracted by human knowledge as AI traditionally has been many times. Instead focus on learning methods that will scale with computation like search and like learning.”
Rich Sutton clarifies the Bitter Lesson in 26 words: avoid human knowledge shortcuts and instead invest in algorithms that scale with compute, like search and learning. He acknowledges the phrase has been widely misused. This matters because it's a foundational framing debate as the industry decides where to invest in next-gen AI architecture.