What's the most cost-effective way to serve lots of large files (lemmy.ml)

submitted 1 year ago by omegastick@lemmy.ml to c/experienced_devs@programming.dev

14 comments fedilink hide all child comments

I'm looking at starting a service that involves hosting a lot of LLM models, which are often going to be 16GB+ (compressed). I did a bit of searching for cloud storage providers with cheap egress, and the cheapest I could find is $0.01 per GB, which would still be $0.16+ per download.

How do sites like Huggingface or CivitAI do it? Lots of VC funding?

you are viewing a single comment's thread
view the rest of the comments

[-] jeff@programming.dev 1 points 1 year ago

There's no harm in messaging the sales team directly. Whatever deals CivitAI got might not work for you, they might not even be legally allowed to mention specifics. But you can shop around and see what different providers will offer you.

this post was submitted on 23 Jun 2023

13 points (93.3% liked)

Experienced Devs

3950 readers

1 users here now

A community for discussion amongst professional software developers.

Posts should be relevant to those well into their careers.

For those looking to break into the industry, are hustling for their first job, or have just started their career and are looking for advice, check out:

Logo base by Delapouite under CC BY 3.0 with modifications to add a gradient

founded 1 year ago

MODERATORS

snowe@programming.dev

jmk1ng@programming.dev

drewsiferr@programming.dev