Indeed... As far as I know at least the Thunderbird donations are not going towards this, its Mozilla funded. I just cannot see that anyone asked or needed this, such a waste of time that should have gonw towards Thunderbird.

Actually, businesses need this to control AI use, log requests, be CMMC compliant, etc.

The proxy to multiple backends is intetesting.

It sounds like a step further than open-webui; it’s an enterprise grade client-server model for access to agents, workflows, and centralized knowledge repositories for RAG.

In addition to local chatbot for executive/admin use, I can see this being the backend for developers running Cursor or some other AI enhanced IDE, with local knowledge stores holding proprietary documents and running against local large models.

I am also curious about time share and prioritization of resources; I assume it would queue simultaneous requests. Presumably this would let you more effectively pool local compute, rather than providing A100 GPUs to each developer that may sit unused when they’re not working.

Edit: Somewhat impressively, this whole stack does not even include a local inference provider; so it does everything except local models right now, and requests are forwarded to cloud inference providers (Anthropic, OpenAI, etc). But it does have the backend started for rate limiting and queuing, and true “fully offline/local” is on the roadmap, just not there yet.

At last a useful comment thread about the actual functionality in question.

While I am not moving back to reddit, Threadiverse is just terrible on any nuanced conversations on modern ML tools and approaches.

The tech is not the issue here. It has legitimate use cases and it is here to stay (this is not a blockchain pump and dump scheme ala Web 3.0). The issue here are American tech companies and broader support for crime/corruption in US society (as of today, doesn't mean that this can't/won't change in 20-30 years). We need truly independent open source systems and tools.

I am aware OpenWebUI is based in San Francisco and Mozilla Foundation is based in the US. I am always on the lookout for alternatives.

It really eats.. the llamas ass

But its kinda taken....

I don't think their market share/relevance would start rising if they just maintained the status quo.

Which isn't to say this direction is great or the way to go about it, but they can't do nothing either.

I have read summaries of emails and meetings that had the action items all sorts of wrong, sometimes completely inverted.

It seems to me that if an email or meeting is at all important, the stakes are too high to trust the summary, and if it is not important, neither is its summary.

Add on to that the fact that locally running LLMs are even more scatterbrained, I don't see how this fills even the limited need you're describing in any useful way.

So, they spent their limited available manpower on an unrequested feature, and to add insult to injury, the feature is unlikely to have effective practical uses. It might be capable of more limited scope text prediction like code auto-complete, but the field is already flooded with those. I think the Thunderbird users have far more use from improvements to Thunderbird than they do for other unrelated products.

Could you explain what email summaries have to do with this announcement? Thunderbird and Thunderbolt are separate applications. Thunderbolt doesn't include AI models, it is merely a frontend to an AI API of choice, similar to how Thunderbird is a frontend to an email server of choice.

Omg take my money!! 💸💸💸💸

Seriously loosing whatever faith i had left in Mozilla... I want to love them so badly, but this just hurts.

AND all caps “trusted by organisations that don’t compromise”

TBH that sounds like a warning.

From what I can see, this is something the Thunderbird team had developed for their own internal tooling, and they’re open sourcing it.