18
submitted 2 weeks ago by vermaterc@lemmy.ml to c/technology@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] vermaterc@lemmy.ml 2 points 2 weeks ago

To be fair, not all knowledge of LLM comes from training material. The other way is to provide context to instructions.

I can imagine someone someday develops a decent way for LLMs to write down their mistakes in database and some clever way to recall most relevant memories when needed.

[-] yogthos@lemmy.ml 1 points 2 weeks ago

there are already existing approaches tackling this problem https://github.com/MemTensor/MemOS

[-] JumpyWombat@lemmy.ml 1 points 2 weeks ago

You sort of described RAG. It can improve alignment, but the training is hard to overcome.

See Grok that bounces from “woke” results to “full nazi” without hitting the mid point desired by Musk.

this post was submitted on 22 Jul 2025
18 points (84.6% liked)

Technology

39242 readers
119 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 6 years ago
MODERATORS