802

Normal day in the life of a developer (lemmy.world)

submitted 1 year ago by Dehydrated@lemmy.world to c/programmer_humor@programming.dev

41 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] virku@lemmy.world 4 points 1 year ago

I am researching doing the same, but know nothing about running my own yet. Did you train your llm for programming in any way, or just download and run an open source one? If so which model etc do you use?

[-] lunachocken@lemm.ee 1 points 1 year ago

Have a look at llama file models they're pretty cool, just rename to xxx.exe and run on windows and chmod on Linux.

Though the currently supported ones are limited, you could try llama code.

[-] virku@lemmy.world 1 points 1 year ago

Where do you get it? Hugging face?

[-] moonpiedumplings@programming.dev 2 points 1 year ago

https://llamafile.ai (though it's down for the moment)

https://github.com/Mozilla-Ocho/llamafile

Lot's of technical details, but essentially the llamafile is a engine + model + web ui, in a single executable file. You just download it and run it and stuff happens.