114
submitted 2 days ago by petsoi@discuss.tchncs.de to c/linux@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments

Any examples of these, please?

[-] StinkySocialist@lemmy.ml 5 points 1 day ago

I may be slipping up on jargon.😅

I think the versions of deepseek you can get from olama are FOSS. I have that running on my homelab and can access it with open webui. Are you looking for something like that? I could link some stuff.

Thanks! I will do some searching on my own, and your comment is a good starting point. I will probably ask you for links if I'm unable to find anything.

May I ask what kind of hardware you use to run your LLMs? Like, do you have a rack full or GPUs?

[-] StinkySocialist@lemmy.ml 6 points 1 day ago* (last edited 1 day ago)

I got an old machine off eBay(see pic) I only run models that are 8b parameters or less.

I got Ubuntu server on it. Then docker running in that. In docker I have olama, open web UI, jellyfin and a game sever. No issues running any of that.

Edit: if you want something that can run better LLMs I recommend more RAM and a better GPU

Nice! Do you use the models for coding? Or image generation, for example?

[-] StinkySocialist@lemmy.ml 1 points 1 day ago

I use them mostly for helping me write emails or meal prepping tbh lol. I've used deep seek to help me with python before but if you're not just dicking around like me you'd definitely want something more powerful.

For image generation it sounds like this tool called comfy UI is the way to go. I have it running in docker but haven't set anything up inside it yet.

It's pretty neat, I really set this up to help keep my data out of the hands of the corps and the feds lol.

[-] einkorn@feddit.org 3 points 1 day ago

Not that I am aware of atm, but I am very certain that people are working on them.

this post was submitted on 30 Jan 2026
114 points (96.7% liked)

Linux

57274 readers
493 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 6 years ago
MODERATORS