Guide to Self Hosting LLMs with Ollama.
- Download and run Ollama
- Open a terminal, type
ollama run llama3.2
Guide to Self Hosting LLMs with Ollama.
ollama run llama3.2
+1 for the main risk to my service reliability being me getting distracted by some other shiny thing and getting behind on maintenance.
The Debian thong made me laugh. Who is buying this? For themselves, their partners? I'm imagining Christmas morning when I'm trying to explain the value of this gift you've just opened.
I still have not landed on a music system. I've put some of my library on Jellyfin, and tried a couple of apps with, but haven't hit on a good combination yet. [edit:formatting}
I read somewhere that GoPros and other action cameras are one of the least used purchases, so I figured "that should mean there's plenty on eBay". So grabbed up second hand bargain, played around with it for a couple of weeks, bought some extra batteries and other accessories, and since then it's sat in the cupboard except for a single occasion.
Turns out you don't need an action cam if you're not getting any action.
I've just been down this exact journey, and ended up settling on Kavita. It has all the browse, search and library stuff you'd expect. You can download or read things in the web interface. I'm only using it for epub and PDF books, but its focus is comics and manga so I expect it to shine there.
I don't think it does mobi, but since I use Calibre on my laptop to neaten up covers and metadata before I drop books on to the server it's a simple matter to convert the odd mobi I end up with. Installation (using docker inside an LXC) was simple.
It's been a really straightforward, good experience. Highly recommend. I like it better than AudioBookshelf (which I'm already hosting for audio books) which I also tried, but didn't like as much for inexplicable reasons. I also considered Calibre-Web, but that seemed a bit messy since I guess I'd use Calibre on my laptop to manage my books on a NAS share then serve it headless from the server with Calibre-Web? I might have that completely wrong, I didn't spend any time looking into it because Kavita was the second thing I tried and it did exactly what I wanted.
It has a practical element (Hello Jellyfin, Kavita, AudioBookshelf & Syncthing), but for the rest of it, it's about 60% hobby and 20% learning stuff that could be potentially career enhancing.
Gnu/Linux absolutely annihilating server operating systems means that I can run the same stack, and use the same tools, that giant companies are based on. All for free. In my spare room. 1L x86 computers cost less than two packs of cigarettes! Little SSD's are ridiculously cheap. And you don't even need that stuff - that old laptop in your cupboard will do. Even if you kick in to donate for your software (and I recommend you do if you can) it's a cheap hobby compared to golf or skating or whatever. Anything you need to learn there's blog posts and videos available.
We live in an amazing time in this hobby. I know there's companies that would like to take it away from us, but Open Source just keeps kicking goals. Thank you FOSS developers, Gnu, Linus, FSM, Cthulhu and the other forces in the universe that make this possible.
Me too. I've been carrying it around in my head as "the time we listened to scientists, and almost everyone worked together on some short term pain for worldwide long term gain". I was even hoping we might do something like that again.
Would be handy for attaching your name badge, or if you need to put those little hard drive screws somewhere so you don't lose them.
Tailscale is a very cool way of seamlessly creating a private network spread out geographically. Devices sign into the Tailnet from anywhere. It's very big in the selfhosted community (it has a generous free tier). For example my home servers are signed in, so I'm able to stream from my media server to my phone over my private Tailnet tunneled through the internet. I also have an offsite backup location with another server connected to the Tailnet for accepting automated backups.
The underlying technology is Wireguard. It is very smart about figuring out the most effective route - If I'm on my laptop in my home wifi, trafffic from my servers is direct, if I'm away somewhere, it's piped though the net securely. What Tailscale adds is ease of setup and native apps for each device.
The privacy angle is that I'm able to get rid of all the cloud services I used to rely on. For example I don't want my CCTV system connected to a cloud provider, but with Tailnet I can connect to my cameras over the internet without having to expose the system to a data mining corporation.
Two good points here OP. Type
docker image ls
to see all the images you currently have locally - you'll possibly be surprised how many. All the ones tagged<none>
are old versions.If you're already using github, it includes an package repository you could push retagged images to, or for more self-hosty, a local instance of Forgejo would be a good option.