53
Meta genai org in panic mode
(www.teamblind.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 24 Jan 2025
53 points (100.0% liked)
technology
23499 readers
318 users here now
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
- Ways to run Microsoft/Adobe and more on Linux
- The Ultimate FOSS Guide For Android
- Great libre software on Windows
- Hey you, the lib still using Chrome. Read this post!
Rules:
- 1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
- 2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
- 3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
- 4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
- 5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
- 6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
- 7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.
founded 4 years ago
MODERATORS
But what is to limit Nvidia from just shifting to "wow now that more can be done with less, we will do even more with EVEN MORE CARDS" and apply the improvements from Deepseek to their own models while continuing to ramp up in the same way?
Eventually there will be a pop, but I genuinely don't get how this ushers in that pop. I guess the diminishing returns of these systems is hastened? As in, adding more cards with more resources will continuously have less effect. But companies will for now still want even the smallest edge by putting Deepseek-style-improved-AI on even bigger data centers.
That's what OpenAI thought originally when they started working on ChatGPT5, they figured they'd just make the model bigger and it's going to do more. Turns out that making the model bigger doesn't actually produce better results. We're also at a point now where most of the publicly available information has been scraped as well. Now the focus is turning towards improving algorithms for making sense of the data as opposed to just stuffing more data into the model. And this is a problem for Nvidia because current generation of chips is already good enough for doing this.
Of course, people will find ways to utilize more processing power as is always the case. But at least in the near term, this is no longer the bottleneck.
Interesting, I was unaware that we had already hit the limits of used data. That makes sense then. I hope that your analysis is correct, it'd be good news