Thread by @tmramalho on Thread Reader App
The next big breakthrough in AI will come from hardware, not software. Training giant models like PaLM already require 1000s of chips consuming several MW, and we will probably want to keep scaling these up several orders of magnitude. How can we do it?
https://threadreaderapp.com/thread/1537358275523407873.html?s=12&t=8Ltr9BZupu01i0Kp9uBjjg
