Local LLMs (which no one should care about or be using)
Yeah local LLMs are genuinely the ONLY thing the framework desktop is interesting for. For gaming, it is cheaper, more repairable, more upgradable, and more performant to just build a PC normally.
Why should no one care about or be using local LLMs, though? What a strange thing to say.
Because they serve no purpose.
Is that why models on HuggingFace have monthly download counts in the millions?
No, that's because people are easily duped by unprecedented investments in marketing.
Sounds like you're coping. Especially since marketing for local LLMs is not a thing.
WTF is a cope? There's no way anyone actually thinks that marketing for LLMs is not a thing so I can only surmise that your intention is to argue in bad faith or otherwise troll. In which case, goodbye.
Could you provide a single example of marketing for a local LLM?
Do you have any evidence that investment in marketing of LLMs is actually "unprecedented" or trending any differently than marketing as a whole?
I can provide an example of a purpose for a local LLM: offline translation of documents written in a foreign language.
How much impact do you think marketing had on hugging face, considering it's free?
100% of it, considering HuggingFace wouldn't exist without LLM marketing.
It is typical anti-science conspiracy theorist "secret knowledge" mindset. People like OP want to feel like they know something others don't, so they allow themselves the delusion that, despite no personal expertise or knowledge of the topic, they actually know better than the companies risking billions on AI investments and expert researchers/academics with decades long careers in AI/ML.
They are the same as other science deniers, like anti-vaxxers believing they actually know better than doctors and medical researchers because of an anecodote they read online.
Wow you're REALLY buttchugging the corporate koolaid...
claiming that working with free, open source, self hosted, privacy-focused local LLMs means you've drunk the corporate Kool aid is only further discrediting yourself on this topic...
I saw it more as an AI bro machine rather than gaming-centric. It happens to play games fairly decently though provisions a great deal of gfx die area in doing so.
I agree with you that it's daft for a company like framework to put that out. wouldn't it be lovely if something like strix halo could work on a socketed system, perhaps leveraging a different memory technology than DDR5 UDIMMs
The whole point of this chip is unified memory, which can only be done using soldered memory. Using DIMMs would mean it must be typical shared memory, like any other APU/iGPU.
If the framework desktop came with a "normal" CPU/APU with non-soldered RAM, it would just be exactly the same as any other prebuilt desktop.
Then maybe they just shouldn't have made a desktop? It's like I said, this is a market segment that's already extremely repairable/upgradeable, and doesn't require their attention.