226
Save The Planet
(lazysoci.al)
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
Related communities:
Let’s do the math.
Let’s take an SDXl porn model, with no 4-step speed augmentations, no hand written quantization/optimization schemes like svdquant, or anything, just an early, raw inefficient implementation:
https://www.baseten.co/blog/40-faster-stable-diffusion-xl-inference-with-nvidia-tensorrt/#sdxl-with-tensorrt-in-production
So 2.5 seconds on an A100 for a single image. Let’s batch it (because that’s what’s done in production), and run it on the now popular H100 instead, and very conservatively assume 1.5 seconds per single image (though it’s likely much faster).
That’s on a 700W SXM Nvidia H100. Usually in a server box with 7 others, so let’s say 1000W including its share of the CPU and everything else. Let’s say 1400W for networking, idle time, whatever else is going on.
That’s 2 kJ, or 0.6 watt hours.
…Or about the energy of browsing Lemmy for 30-60 seconds. And again, this is an high estimate, but also a fraction of a second of usage for a home AC system.
…So yeah, booby pictures take very little energy, and the usage is going down dramatically.
Training light, open models like Deepseek or Qwen or SDXL takes very little energy, as does running them. The GPU farms they use are tiny, and dwarfed by something like an aluminum plant.
What slurps energy is AI Bros like Musk or Altman trying to brute force their way to a decent model by scaling out instead of increasing efficiency, and mostly they’re blowing that out of proportion to try the hype the market and convince them AI will be expensive and grow infinitely (so people will give them money).
That isn’t going to work very long. Small on-device models are going to be too cheap to compete.
https://escholarship.org/uc/item/2kc978dg
So this is shit, they should be turning off AI farms too, but your porn images are a drop in the bucket compared to AC costs.
TL;DR: There are a bazillion things to flame AI Bros about, but inference for small models (like porn models) is objectively not one of them.
The problem is billionaires.
I don’t disagree with you but most of the energy that people complain about AI using is used to train the models, not use them. Once they are trained it is fast to get what you need out of it, but making the next version takes a long time.
This is a specious argument.
Once a model has been trained once they don't just stop training. They refine and/or start training new models. Showing demand for these models is what has encouraged construction on 100s of new datacenters.
Only because of brute force over efficient approaches.
Again, look up Deepseek's FP8/multi GPU training paper, and some of the code they published. They used a microscopic fraction of what OpenAI or X AI are using.
And models like SDXL or Flux are not that expensive to train.
It doesn’t have to be this way, but they can get away with it because being rich covers up internal dysfunction/isolation/whatever. Chinese trainers, and other GPU constrained ones, are forced to be thrifty.
And I guess they need it to be inefficient and expensive, so that it remains exclusive to them. That's why they were throwing a tantrum at Deepseek, because they proved it doesn't have to be.
I'm really OOTL when it comes to AI GHG impact. How is it any worse than crypto farms, or streaming services?
How do their outputs stack up to traditional emitters like Ag and industry? I need a measuring stick
These two things are so different.
Streaming services are extremely efficient; they tend to be encode-once and decode-on-user's-device. Video was for a long time considered a tough thing to serve, so engineers put tons of effort into making it efficient.
Crypto currency is literally designed to be as wasteful as possible while still being feasible. "Proof-of-work" (how Bitcoin and many other currencies operate) literally means that crypto mining algorithms must waste as much computation as they can get away with doing pointless operations just to say they tried. It's an abomination.
I legit don't know much about tech, and it ts showing. I didn't know streaming was so efficient.
What I. Trying to get at (I still have to read that article in the parent comment) is that how is AI any worse than crypto? As far as I can tell crypto impact, while bad, was relatively minor and it drastically decreased in popularity; it's kind of logical AI does the same, unless it's impact is way higher.
Meanwhile we have cargo ships burning bunker crude .