42
GitHub here: https://github.com/allenai/OLMoE.swift
Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924
Wanna see how you git clone and compile it on ios
I wonder how bit it is, normally they call them something with 3B or 7b
It’s 7 billion parameters big.
Ah, nice, not bad for a iPhone model.
Why only iPhone?
according to the linked article, it sounds like it is for performance reasons.
It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.
Explain it pls
It's Apple's API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it's actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml
Seems like a good project to implement on the green side (Or pinguin side)
this post was submitted on 07 Mar 2025
42 points (93.8% liked)
Open Source
33247 readers
287 users here now
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
- !libre_culture@lemmy.ml
- !libre_software@lemmy.ml
- !libre_hardware@lemmy.ml
- !linux@lemmy.ml
- !technology@lemmy.ml
Community icon from opensource.org, but we are not affiliated with them.
founded 5 years ago
MODERATORS