@[email protected] to [email protected]English • 2 months agoMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comexternal-linkmessage-square156fedilinkarrow-up1626cross-posted to: [email protected][email protected]
arrow-up1626external-linkMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.com@[email protected] to [email protected]English • 2 months agomessage-square156fedilinkcross-posted to: [email protected][email protected]
minus-square@[email protected]linkfedilinkEnglish100•2 months agoOptimizing AI performance by “scaling” is lazy and wasteful. Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
minus-square@[email protected]linkfedilinkEnglish1•1 month ago don’t worry about performance, GHz will always go up TF2 devs lol
minus-squareNoiseColor linkfedilinkEnglish26•2 months agoThing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷linkfedilinkEnglish5•2 months agoTo be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
minus-square@[email protected]linkfedilinkEnglish1•1 month agoIt always wins in the end though. Look up the bitter lesson.
minus-square@[email protected]linkfedilinkEnglish16•2 months agohttps://en.wikipedia.org/wiki/Wirth's_law
Optimizing AI performance by “scaling” is lazy and wasteful.
Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
TF2 devs lol
Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
To be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
I miss flash players.
It always wins in the end though. Look up the bitter lesson.
https://en.wikipedia.org/wiki/Wirth's_law
TIL