131
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 31 Aug 2023
131 points (95.8% liked)
Ask Lemmy
26669 readers
1814 users here now
A Fediverse community for open-ended, thought provoking questions
Please don't post about US Politics.
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
founded 1 year ago
MODERATORS
Look up UC Berkeley's CS61A, B, and C, then start looking deeper into the CS curriculum to find the pieces you are missing. For me, it took trying to optimise the CPU scheduler for single threaded processes in Linux, specifically complex assemblies in FreeCAD. That lead me to a few lectures about the scheduler in the OS principals course. I've done a bunch of little embedded projects but struggle with complexity. The concepts around a scheduler are what I was missing. There are a lot of things like this that are readily available for free online if you just go searching for them specifically.
If you want to really free yourself, I run a offline Llama2 70B with GGML 4bit to code. It works well for snippets and can do better than 3 tokens a second on a 12th gen i7/64GB and 16GBV 3080Ti. It can run at around 2 tokens a second on just the CPU, but you'll need a Linux machine with an additional 8GB swap partition just to initially load the model. It takes around 43GB to run after init.