286
Everything Apple iOS 18 Will Do, Android Already Does
(gizmodo.com)
This is a most excellent place for technology news and articles.
Yes. Android already does all these things. But I think the things I’m excited most about are not on this list at all.
A private local LLM. With the on-device context of my notes, messages, calendar, etc, I’m rather excited to have a more personal LLM than ChatGPT.
Personal messaging via satellite. I love that I can stay in touch with people outside of a cell network.
Running on a phone? No way, not without being absolutely horrible, slow or making your phone churn through your battery anyway.
Good LLMs are olready slow on a GTX 1080, which is already miles faster than any phone out there
It's not a LLM, it's a much smaller model (~3B) which is closer to what Microsoft labels as a SLM (Small Language Models, e.g. MS Phi-3 Mini).
https://machinelearning.apple.com/research/introducing-apple-foundation-models
Microsoft's penchant for making up names for thing that already have names is neither here nor there. It is an LLM, in fact its already twice as large as chatGPT2 (1.5B params).
I do think it's a useful distinction considering open models can be more than 100B+ nowdays and GPT4 is rumored to be 1.7T params. Plus this class of models are far more likely to be on-device.