AI in Practice

Meta releases Muse Glimmer: AI agent for a graphics card

3 min read

TL;DR Too Long; Didn’t read

Meta introduces Muse Glimmer, an open 30-billion-parameter model for local AI agents that runs completely without cloud servers. Four-bit quantization reduces the memory requirement to 18 to 20 gigabytes, so a single consumer graphics card is enough. The weights are available for free under Apache 2.0 on Hugging Face.

A graphics card with a Meta logo sticker sits on a desk, a small robot arm rises from its fan and types on a laptop keyboard, next to it floats a crossed-out cloud. Image generated with GPT Image 2

Key takeaways

  • A 30-billion-parameter agent model runs with Muse Glimmer completely without a cloud connection for the first time.
  • Four-bit quantization reduces the memory requirement from 55 to 18 to 20 gigabytes.
  • The open weights are available for free under the Apache 2.0 license on Hugging Face.
  • Meta distills the model from its larger cloud model Muse Spark.
  • Meta says Muse Glimmer outperforms the open models Gemma4-31B and Qwen3.6-27B on agent benchmarks.
  • Ollama already supports the model at launch from version 0.32.7.

Meta introduced an open agent model called Muse Glimmer with 30 billion parameters on August 10, 2026, which runs entirely locally on a single consumer graphics card. The company distills the model from its larger cloud model Muse Spark and makes it available for free under the Apache 2.0 license on Hugging Face. Unlike previous agent models, Muse Glimmer no longer needs a cloud connection.

Four-bit quantization cuts memory needs to one third

Muse Glimmer combines a 28-billion-parameter text decoder with a two-billion-parameter image encoder in the ViT style, which processes text, images, and short video sequences together. A changing mix of local attention windows and full attention, plus a method called “gated” key-value caching, reduces the memory needed for context by a factor of sixteen, according to Meta’s own research blog. With additional four-bit quantization, total memory demand drops from 55 to 18 to 20 gigabytes, letting the model, cache, and image encoder fit on a single graphics card with 24 or 32 gigabytes.

An extra component called DFlash speeds up text generation through speculative decoding by a factor of 1.5 to 3.1, reaching up to 20,000 tokens per second on one graphics card. At launch, the Transformers library, llama.cpp, and vLLM support the model directly, as do Hugging Face’s own cloud inference endpoints. According to Phoronix, the local model server Ollama also integrates Muse Glimmer starting from version 0.32.7 on launch day; Meta announces optimized support for MLX and ExecuTorch, plus integrations with LM Studio, Unsloth, SGLang, Together AI, Fireworks AI, and OpenRouter, for the coming days.

Model inherits capabilities from the larger Muse Spark

Muse Glimmer is created through so-called logit distillation from Muse Spark, Meta’s larger cloud model, and follows the same training data in a more compact form. The smaller model inherits multi-step reasoning, reliable tool use including multimodal function calls, and error recovery for failed tasks. It processes video sequences with up to 96 frames at two frames per second without sound, handles more than 100 languages, and lets users specifically control its depth of reasoning.

On agent benchmarks such as MCP Atlas, Muse Glimmer scores 75.5 points according to Meta, against 54.2 for Gemma4-31B, while on the SWE-Bench Pro coding benchmark it scores 51.2 against 36.9 points – independently unverified. On the multimodal test Charxiv Reasoning, Muse Glimmer reaches 78.8 points; as comparison models, Meta cites Gemma4-31B and Alibaba’s Qwen3.6-27B. Meta sees use cases including local coding agents and as a judge for other AI outputs, similar to the already-launched terminal agent Muse Code, which also builds on the Muse Spark family but still depends on cloud compute.

Release lands amid Meta’s open-source strategy shift

With Muse Glimmer, Meta again positions itself as a provider of open models, after the company first switched from the open Llama series to closed Spark models in April 2026 – partly in response to criticism that Spark models trail competing products from OpenAI and Anthropic in independent tests. The new course also answers growing competitive pressure from open models out of China, such as DeepSeek, and Germany, such as Soofi S from a German research consortium.

Meta explicitly frames the open weights as a counterpoint to centralized, closed AI systems from individual providers, courting developers who want no cloud connection for cost or privacy reasons. The launch also lands during a phase of growing interest in locally running AI, as more companies decline to hand sensitive data to external server infrastructure. For freelancers and smaller firms or practices, that means an AI agent for scheduling and file organization could soon run on their own machine, with no documents leaving the premises. Meta has not yet given a rollout date for further, larger Muse Glimmer variants.

What matters now is whether independent developers confirm the benchmark figures Meta cites, and whether always-on local agent models prove trustworthy enough in practice – just weeks earlier, Meta had to disclose a security incident involving the larger predecessor model Muse Spark.

Frequently asked questions

What does Muse Glimmer cost?

Nothing. The model weights are available for free download on Hugging Face under the permissive Apache 2.0 license.

What hardware does Muse Glimmer need?

A single consumer graphics card with 24 or 32 gigabytes of video memory is enough, since four-bit quantization reduces the requirement to 18 to 20 gigabytes. The model runs on Mac and PC.

Is Muse Glimmer available in Germany and the EU?

Yes. Since these are open model weights, Muse Glimmer can be downloaded worldwide without access restrictions; Meta names no regional limitations.

How does Muse Glimmer differ from Muse Spark?

Muse Glimmer is a smaller variant distilled from Muse Spark for local use instead of the cloud, with fewer parameters but, according to Meta, comparable agent capabilities.

Which tools already support Muse Glimmer?

Ollama integrates the model from version 0.32.7 at launch. Meta announces optimized support for llama.cpp, MLX, and ExecuTorch for the coming days, plus planned integrations with LM Studio, Unsloth, vLLM, SGLang, Together AI, Fireworks AI, and OpenRouter.

Sources (5)
  1. Introducing Muse Glimmer: An Open Agentic Model That Runs on Your Device – Meta AI Research
  2. Muse Glimmer – Hugging Face Blog
  3. Meta's open source Muse Glimmer model can run on a single computer – Engadget
  4. Meta Publishes Muse Glimmer As 30B Open Agentic Model – Phoronix
  5. Meta releases Muse Glimmer as an open local agent model – Techzine Global

Your AI update for the work week

Once a week, the most important AI news – plus one practical tip to try right away. No spam, unsubscribe anytime.

← Back to the blog