1
Orbit by Mozilla (orbitbymozilla.com)
submitted 6 months ago* (last edited 6 months ago) by umami_wasbi@lemmy.ml to c/technology@lemmy.world
3 comments fedilink hide all child comments

New Mozilla AI project. Put "trust" and "privacy" in the title and subtile but doesn't support locally hosted model.

Exists as an add-on today. Model is Mistral 7B hosted by Mozilla in GCP. Claims won't save data long term. Promises won't use personal information to train models and not share queries with Mistral or any other services.

Am I going to use it? No. Not without local model supported.

Note: the mobile version of the page is broken (lack of many content). Best to view the desktop version for complete details.

top 3 comments
sorted by: hot top controversial new old
[-] Bjornir@programming.dev 0 points 5 months ago

Could you run Mistral 7B on a consumer grade desktop ?

[-] kate@lemmy.uhhoh.com 1 points 5 months ago

Consumer-ish. I can run it on my MacBook Pro, any 8GB VRAM nvidia card should be able to run it. Technically, any machine with 8GB system memory if you’re willing to run it really slowly

[-] umami_wasbi@lemmy.ml 1 points 5 months ago* (last edited 5 months ago)

Yes. Depends on the actual hardware, parameters used, and model quantization, you can get 2~10 tok/s on CPU alone.

this post was submitted on 08 Jan 2025
1 points (100.0% liked)

Technology

72472 readers
1001 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws