304
submitted 9 months ago by KarnaSubarna@lemmy.ml to c/linux@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] possiblylinux127@lemmy.zip 5 points 9 months ago

I'll run which ever doesn't require a bunch of proprietary software. Right now its neither.

[-] domi@lemmy.secnd.me 9 points 9 months ago

AMD's ROCm stack is fully open source (except GPU firmware blobs). Not as good as Nvidia yet but decent.

Mesa also has its own OpenCL stack but I didn't try it yet.

[-] possiblylinux127@lemmy.zip 0 points 9 months ago

AMD ROCm needs the AMD Pro drivers which are painful to install and are proprietary

[-] domi@lemmy.secnd.me 15 points 9 months ago

It does not.

ROCm runs directly through the open source amdgpu kernel module, I use it every week.

[-] possiblylinux127@lemmy.zip 3 points 9 months ago* (last edited 9 months ago)

How and with what card? I have a XFX RX590 and I just gave up on acceleration as it was slow even after I initially set it up.

[-] domi@lemmy.secnd.me 10 points 9 months ago* (last edited 9 months ago)

I use an 6900 XT and run llama.cpp and ComfyUI inside of Docker containers. I don't think the RX590 is officially supported by ROCm, there's an environment variable you can set to enable support for unsupported GPUs but I'm not sure how well it works.

AMD provides the handy rocm/dev-ubuntu-22.04:5.7-complete image which is absolutely massive in size but comes with everything needed to run ROCm without dependency hell on the host. I just build a llama.cpp and ComfyUI container on top of that and run it.

[-] possiblylinux127@lemmy.zip 1 points 9 months ago

That's good to know

this post was submitted on 26 Jan 2024
304 points (99.4% liked)

Linux

48113 readers
676 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS