media r/LocalLLaMA · 1h ago · open_models

Austria rolls out GovGPT for 180,000 federal employees using Mistral and Open WebUI

from English

Austria is deploying "GovGPT," a government AI platform built on sovereign infrastructure at the BRZ federal datacenter. The system utilizes Mistral open-weight models and the Open WebUI interface to serve public sector needs.

The rollout targets approximately 180,000 federal employees, with broader implications for around 250,000 public sector workers.
Planned use cases include document chat, internal knowledge bases, electronic-file analysis, parliamentary requests, and future agentic workflows.
This deployment is noted as one of the largest government implementations of open-weight models and freely available chat platforms.

The initiative aims to support administrative efficiency and address staffing challenges within the Austrian public sector.

Importance 2/3 r/LocalLLaMA Mistral AI AI agents Open weights

Read original

media r/LocalLLaMA · 34d ago · 1 view

mistral.rs v0.8.10 adds /v1/skills support for local models

mistral.rs v0.8.10 introduces OpenAI-compatible Agent Skills via a /v1/skills endpoint, enabling local models to execute domain-specific instructions and scripts without relying on frontier APIs. The update supports tools like file uploads and downloads via /v1/files and includes prebuilt binaries for Linux, macOS, and Windows.

arxiv arXiv cs.LG · 34d ago

Reverse-Engineering Transformer Attention with Executable Programs

A new method uses program synthesis to generate Python programs that reproduce attention patterns in transformer models. These programs achieve over 75% average Intersection-over-Union similarity on held-out data and can replace up to 25% of attention heads with minimal impact on model performance, increasing perplexity by only 16% on average.

media r/LocalLLaMA · 35d ago

Local models went from mostly useless to actually useful in one year

Local models transitioned from being primarily privacy-focused toys to practical tools for coding, private document management, and local workflows within a year. While they still fall short of replacing top closed models for complex tasks requiring planning and error correction, the overall improvement in usability and performance is evident.

arxiv arXiv cs.CL · 37d ago · 5 views

LOGOS: A General-Purpose Generative Model for Natural Sciences

LOGOS is a unified generative language model that represents scientific objects and their interactions as token sequences in a shared grammar. It achieves consistent or superior performance across diverse natural science tasks, demonstrating the feasibility of a single model serving multiple domains. The model scales positively with parameter count, and its design suggests that AI for Science should align deeply with large language models through shared architectures and training.

media r/LocalLLaMA · just now Live

Microsoft Research releases Fara1.5-27B multimodal computer use agent

Microsoft Research AI Frontiers has released Fara1.5-27B, a multimodal computer use agent designed for web browsers. The model observes browser interfaces through screenshots and executes tasks by emitting structured tool calls such as clicking, typing, scrolling, and searching.