[-] gens@programming.dev 1 points 6 days ago* (last edited 6 days ago)

The programs usually mmap the file into memory. That means that parts of it are loaded as used and unloaded if there is no memory left. That's why it does not say it is using memory. Check disc i/o as it is generating the message. For linux that can be seen in htop or iotop, for win idk.

Note that I use lmstudio, that uses llama.cpp to run models. Gpt4all, I think, uses a modified version of same. Doesn't matter they should all be using mmap to load the file.

PS Depending on the model I also get a couple tokens per sec on the cpu.

Edit: Didn't see someone already said the same, I'l leave this here anyway.

[-] gens@programming.dev 28 points 1 week ago

I'v seen him DJ

[-] gens@programming.dev 23 points 3 months ago

I feel like you are making up words

[-] gens@programming.dev 70 points 3 months ago

The tip heats up enough to melt solder.

[-] gens@programming.dev 26 points 1 year ago

Well, he is the god of war. He wishes his kids to grow up strong and respected like him. Don't be so harsh on the guy, he's doing his best you know.

[-] gens@programming.dev 36 points 1 year ago

I actually kinda like that one.

[-] gens@programming.dev 23 points 1 year ago

Gimp Tool Kit, where gimp means Gnu Image Manipulation Program, where gnu means Gnu's Not Unix. So, in short, gnu's not unix image manipulation program tool kit.

[-] gens@programming.dev 27 points 1 year ago

0-127, top bit is always 0.

[-] gens@programming.dev 45 points 1 year ago

I'd like all files to have a big comment on top that says wtf this is, why is it, and roughly how it works. Bonus for ascii art.

[-] gens@programming.dev 24 points 2 years ago

Apple is notorios about being anti-gaming, yet many games support it while not supporting linux. Don't know the actual stats though.

[-] gens@programming.dev 46 points 2 years ago

You know what would drive demand up ? Cheap wine.

120

It's small, palm sized. Lid is held with friction. Pine in tung oil. Feels much better then it looks. I'm not much of a woodworker, as it shows :)

view more: next ›

gens

joined 2 years ago