Microelectronics Colloquium
Abstract: Rich Sutton has said that the bitter lesson in AI is that “Researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation.”
In this talk, I will present real-world examples of how applications inside and outside of AI scale as computing power increases and what we can learn about Sutton’s conjecture from this empirical data. I will also discuss what it means that, as Moore’s Law fades, computing power increases are becoming more expensive.