22
submitted 12 hours ago by Ivysaur@hexbear.net to c/technology@hexbear.net

...or at least the kind of model that isn't fueled by burning a small forest for every query? I am wanting to play an old video game, but I'm still only just learning the language and could use an aid. I really, really want to avoid any of this incredibly wasteful AI stuff.

all 8 comments
sorted by: hot top controversial new old
[-] lime@feddit.nu 2 points 6 hours ago

i knew this would happen. everything's AI now, so everything must be bad. translation utilities have used machine learning methods for years, long before gpts got useful. translation doesn't have nearly the power requirements of generative stuff. also, for the record, it's not the usage of generative ai that's wasteful, it's building the model. the models are already built.

but anyway, it sounds like you want to run something on your own machine. there are tools for this. some of them are engine-specific, others do video capture. RPG maker and various visual novel engines for example have tons of them, where you just run the game using the tool and it replaces all the text. there are similar things for emulators.

is this something that's desirable, or do you want to use the game more as a language learning guide so that the original text stays up? in that case the OCR path is probably better, using something like translumo or ugt. they will show the text in a separate window.

[-] Awoo@hexbear.net 1 points 5 hours ago

where you just run the game using the tool and it replaces all the text. there are similar things for emulators.

These are typically locally running LLMs that do the translating as you go along then cache it on the device. It's why there's a delay before the text is replaced, the delay is shorter on higher end machines that process it quicker.

[-] lime@feddit.nu 2 points 5 hours ago

well, not typically llms. these tools have been around longer than the term.

besides, i don't see why it matters? energy-wise, the problem isn't the tech, it's the immense scale it's deployed on in order to be instantly available to millions of people. running a translator locally is unlikely to show up on your electric bill if you play any games on your computer.

[-] Awoo@hexbear.net 1 points 5 hours ago

If you're talking about one of those plugins/mods then the AI translation is occurring locally on your machine. The increase in processing use is you on your machine, not a warehouse.

[-] PorkrollPosadist@hexbear.net 13 points 12 hours ago* (last edited 12 hours ago)

Try LibreTranslate. It is a "language model," but it is not a "large" language model along the lines of something like ChatGPT. I am not sure what the training process entails, but it will run on a 10 year old dual core CPU without GPU acceleration. You can test it at libretranslate.org, or you can install it on your own machine if you have Python by running pip install libretranslate. I run LibreTranslate on a meager VPS (the CPU I just described) and the headroom left over from running Mastodon is enough to handle the translation queries locally, without making any remote requests.

[-] joaomarrom@hexbear.net 5 points 11 hours ago

I'm not sure it's not AI, but DeepL has been around for a while, it's at least older than this modern concept of AI, so I think it's a different model. I like it a lot.

[-] ksynwa@lemmygrad.ml 3 points 10 hours ago

Stuff like DeepL and Google Translate use AI but not LLMs. They use much less power from what I can gather. For example Firefox allows you to perform such translation on your computer without using a cloud service like Google Translate and its still pretty fast.

this post was submitted on 16 Nov 2024
22 points (95.8% liked)

technology

23307 readers
383 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS