Deutsche Telekom releases Soofi S 30B-A3B, an open-source MoE hybrid Mamba Transformer foundation model

Deutsche Telekom has released Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model designed for German and English. The model was built end-to-end on the German Industrial AI Cloud.

• It activates only 3B of 30B parameters per token while keeping the inference cache near-constant as context grows, providing a throughput advantage over dense models.
• Pretrained on roughly 27 trillion tokens with up-weighted German data, it matches dense 14 to 27B models on aggregate benchmarks.
• Soofi S achieves the best code aggregates in both languages among 17 open base models and outperforms every European sovereign baseline.
• It obtains the highest English and German evaluation scores among fully open models, ahead of Olmo 3 32B and Apertus 70B.

The release includes weights, selected intermediate checkpoints, full per-source data accounting, hyperparameters, and training and evaluation code under highly permissive terms.