Research

Soofi S: German Consortium Releases Open AI Model

3 min read
Four-panel chart of Soofi S's pretraining dynamics across 27 trillion tokens: learning rate, language-modeling loss, gradient norm, and throughput. Source: Soofi team, technical report (arXiv 2607.09424, CC BY 4.0). Image generated with GPT Image 2
Four-panel chart of Soofi S's pretraining dynamics across 27 trillion tokens: learning rate, language-modeling loss, gradient norm, and throughput. Source: Soofi team, technical report (arXiv 2607.09424, CC BY 4.0).

TL;DR Too Long; Didn’t read

A German research consortium has released Soofi S, an open language model with 31.6 billion parameters for German and English. It was trained on Deutsche Telekom's Industrial AI Cloud in Munich, funded with around 20 million euros from the federal economics ministry. The developers report top scores among open models on combined German-English benchmarks, though these figures have not been independently verified.

Key takeaways

  • 31.6 billion parameters, but only 3.2 billion active per request thanks to a mixture-of-experts architecture.
  • Trained on 512 Nvidia B200 GPUs in Deutsche Telekom's Munich cloud, using roughly 253,000 GPU hours.
  • 27 trillion training tokens, with the German-language share raised to 15.3 percent in phase two.
  • Federal funding of around 20 million euros through the IPCEI-CIS program.
  • Consortium reports top scores among open models versus Apertus 70B and Olmo 3 32B.

A German research consortium has released Soofi S, an open language model trained specifically for German and English. According to its developers, the 31.6-billion-parameter model surpasses the open models Apertus 70B and Olmo 3 32B on combined benchmarks.

Consortium trains model on Telekom infrastructure in Munich

Soofi S is built on a hybrid architecture combining Mamba-2 layers with a mixture-of-experts approach that activates only part of the network per request. Of the 31.6 billion parameters, only 3.2 billion are active per token, which significantly increases compute efficiency compared to classic dense models. The model handles contexts of up to 256,000 tokens.

According to the Soofi project’s technical report, training ran from March to May 2026 on up to 512 Nvidia B200 GPUs at Deutsche Telekom’s Industrial AI Cloud in Munich and consumed roughly 253,000 GPU hours. The facility runs on renewable electricity and uses water from the Eisbach canal for cooling. In total, Soofi S processed about 27 trillion tokens across three phases. The German-language share rose from 7.2 percent in the first phase to 15.3 percent in the second – far above the roughly five percent typically allotted to all non-English languages combined in international models.

Sankey diagram of Soofi S's token composition across the three training phases, showing the German-language share rising to 15.3 percent in phase two. Source: Soofi team, technical report (arXiv 2607.09424, CC BY 4.0).

The initiative is coordinated by the KI Bundesverband, Germany’s AI industry association. Participants include the Fraunhofer Institutes IAIS and IIS, the German Research Center for Artificial Intelligence, and the universities TU Darmstadt, University of Würzburg, and the L3S Research Center at Leibniz University Hannover. Also involved are the Berlin University of Applied Sciences and the companies ellamind and Merantix Momentum. Germany’s Federal Ministry for Economic Affairs and Energy is funding the project with around 20 million euros through the European IPCEI-CIS program.

Benchmarks show an edge on German-language tasks

Among models classified as open, Soofi S takes the top spot in combined German-English benchmarks, according to the project’s own figures. On the HumanEval coding test, the model scores 73.8 percent, and 84.2 percent on its German counterpart, MBPP-DE. On the INCLUDE-DE knowledge test, which covers multiple-choice questions from several subject areas in German, it reaches 61.2 percent. On logical reasoning over everyday and scientific questions in ARC-Challenge-DE, the score is 92.3 percent. These figures come from the consortium’s own evaluation and have not been independently verified.

Chart comparing Soofi S 30B-A3B's capability index and compute throughput to open models such as Apertus 70B and Olmo 3 32B. Source: Soofi team, technical report (arXiv 2607.09424, CC BY 4.0).

In overall performance, Soofi S thus reaches a level comparable to dense models with 14 to 27 billion parameters. At a context length of 40,000 tokens, it also delivers eight- to nine-times higher throughput than comparable dense models. According to the technical report, the model shows weaknesses in German competition-level mathematics and in extracting individual words from texts beyond 32,000 tokens. Intermediate training checkpoints and the base model are available on the platform Hugging Face; an instruction-tuned version is expected to follow.

Project partners see a contribution to Europe’s digital sovereignty

The team led by Kristian Kersting at TU Darmstadt contributed, among other things, an AI-powered pipeline for checking training data quality and a module for logical reasoning. Jörg Bienert of the KI Bundesverband frames the project’s strategic significance this way: “Whoever controls the foundation models controls a central part of future digital value creation.” The L3S Research Center likewise stresses the importance of independent European AI systems, noting that access to powerful foreign models is not guaranteed to remain available.

The project joins models such as Switzerland’s Apertus and the European Teuken model in a growing number of state-funded, open language models built outside the US and China. Unlike purely academic projects, Soofi ties in commercial infrastructure from the outset through the Telekom cloud and industry partners such as Merantix Momentum.

What remains open is whether the instruction-tuned version will turn the model’s currently provisional license into a fully open release, and whether German companies will actually put the model to productive use once industrial testing is complete.

Frequently asked questions

What sets Soofi S apart from other open models like Llama or Mistral?

Soofi S was deliberately trained with a high and rising share of German-language data and uses a Mamba-2 mixture-of-experts architecture that computes more efficiently at long context lengths than classic dense models.

Who funds the Soofi project and how much?

Germany's Federal Ministry for Economic Affairs and Energy funds the consortium with around 20 million euros through the European IPCEI-CIS program.

Where can Soofi S already be used?

The base model and intermediate checkpoints are available for download on Hugging Face; an instruction-tuned version for end applications is expected to follow.

How does Soofi S compare to Apertus and Olmo 3?

According to the project's own figures, Soofi S leads both models on combined German-English benchmarks, though independent tests are still outstanding.

Is Soofi S already fully open source?

The base model is publicly accessible, but according to its model card the final licensing terms for a fully open release have not yet been settled.


← Back to the blog