218
submitted 1 month ago by yogthos@lemmy.ml to c/technology@hexbear.net
you are viewing a single comment's thread
view the rest of the comments
[-] TrashGoblin@hexbear.net 2 points 1 month ago* (last edited 1 month ago)

We might eventually get to a point where LLMs are a useful conversational user interface for systems that are actually intrinsically useful, like expert systems, but it will still be hard to justify their energy cost for such a trivial benefit.

[-] yogthos@lemmy.ml 2 points 1 month ago

The costs of operation aren't intrinsic though. There is a lot of progress in bringing computational costs down already, and I imagine we'll see a lot more of that happening going forward. Here's one example of a new technique resulting in cost reductions of over 85% https://lmsys.org/blog/2024-07-01-routellm/

this post was submitted on 28 Jul 2024
218 points (98.7% liked)

technology

23194 readers
57 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS