At some point AI companies are going to have to charge real money to make a profit from their services. What do you think that amount would be and why? (sh.itjust.works)

submitted 1 day ago by funkless_eck@sh.itjust.works to c/asklemmy@lemmy.ml

45 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] mindbleach@sh.itjust.works 4 points 1 day ago

There are other ways it might work, like if there is a method of compression that is discovered that reduces the necessary RAM and Compute needs by 2-3 orders of magnitude. So models that are considered very large today (100-300 billion params at full quality) might be able to run effectively on a single 32GB GPU that costs a few thousand dollars.

You might want to check in on how well distilled / quantized models are doing, compared to gigundo datacenter versions.

this post was submitted on 23 Apr 2026

60 points (96.9% liked)

Asklemmy

54075 readers

514 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago

MODERATORS