Unsloth Releases GGUF Quantizations of Meta's Muse Glimmer 30B Agentic Model
Unsloth has published GGUF quantizations of Muse Glimmer-30B, a dense 29.6B-parameter causal transformer with a dedicated perception encoder, attributed to Meta Superintelligence Lab in the model card. The model targets autonomous agentic tasks on consumer hardware with a 131,072-token context window and 4-bit quantization under 20GB.
Unsloth has released GGUF quantized versions of Muse Glimmer-30B, a dense causal transformer with a dedicated perception encoder designed for autonomous agentic tasks on consumer hardware. According to the model card hosted on Hugging Face, the model is authored by "Meta Superintelligence Lab," carries an Apache 2.0 license, and lists a release date of August 2026 — details that have not been independently confirmed and should be treated as claims from the source repository rather than a verified Meta announcement.
Architecture and Specs
Muse Glimmer totals approximately 29.6 billion parameters, including a ~1.8B-parameter ViT-G/14 perception encoder for image understanding. The language backbone uses 52 layers, a 6,656 hidden dimension, grouped-query attention at a 16:1 ratio (32 query heads / 2 KV heads), SwiGLU feed-forward layers with a 19,968 intermediate dimension, and RoPE position encoding with theta 500,000 applied to local attention layers. Context length is listed at 131,072+ tokens. The tokenizer uses a 202,048-entry vocabulary. Training data has a knowledge cutoff of January 4, 2026, per the model card. The model is described as distilled from a larger model called "Muse Spark."
Local Deployment Focus
Unsloth applied its Dynamic 2.0 quantization to compress the model to roughly 4-bit precision, shrinking it to under 20GB — small enough to run alongside a KV cache and the perception encoder within a 24GB or 32GB VRAM budget. Unsloth claims this compression introduces only 0.2%–1.0% degradation across an internal average of 15 benchmarks, comparing a full-precision 64GB configuration against 32GB and 24GB quantized variants.
The release also ships a companion "drafter" model based on DFlash for speculative decoding, proposing blocks of 16 tokens per forward pass for verification by the main model. Reported throughput gains include 74.9 to 233.4 tokens/second (3.1x) on an Nvidia RTX 5090, and smaller gains of 1.5x–1.8x on Apple M4 Max and M5 Max chips, according to the source.
Benchmark Claims
The model card reports Muse Glimmer scoring 75.5 on MCP-Atlas, 74.6 on DeepSearch QA, 76.0 on SWE-Bench Verified, 94.7 on AIME 2026, and 83.5 on GPQA Diamond — positioned against comparison models "Gemma4-31B" and "Qwen3.6-27B" in thinking mode, neither of which currently exists as a confirmed public release. These comparisons, along with all benchmark figures, come directly from the uploaded model card and have not been independently verified.
Pricing and Access
As an open-weight model distributed via Hugging Face, there is no per-token API pricing; compute cost is limited to local hardware. Pricing not yet disclosed for any hosted inference offering.
What This Means
The unusual details in this listing — a named lab ("Meta Superintelligence Lab"), a forward-dated release month of August 2026, and benchmark comparisons against models that are not yet publicly confirmed — warrant caution. If genuine, Muse Glimmer represents a serious push toward compact, locally-runnable agentic models with multimodal input and speculative decoding built in. Until Meta or another primary source confirms authorship and release timing, this should be treated as an early or leaked model card rather than a fully verified product launch.
Related Articles
Ollama Adds Support for Meta's 30B "Muse Glimmer" Model, First Release from Meta Superintelligence Labs
Ollama v0.32.7 adds support for Muse Glimmer, a 30B-parameter multimodal model that Meta describes as the first release from its new Meta Superintelligence Labs division. Initial support runs through Ollama's MLX engine on Apple Silicon, with NVIDIA and AMD support promised in the coming days.
Meta Releases Muse Glimmer, First Open-Weight Model Since Llama 4, Paired With Zuckerberg Manifesto on Distillation
Meta has released Muse Glimmer, a 30-billion-parameter open-weight model under Apache 2.0, its first open release since Llama 4 in spring 2025. The launch comes with a Zuckerberg essay defending distillation of rival models and hinting at a future 'dynamic auction' pricing scheme for compute.
Meta Open-Sources Muse Spark 1.2, Announces On-Device Model Family Muse Glimmer
Meta CEO Mark Zuckerberg announced the company will open-source its Muse Spark 1.2 model and launch a new on-device model family called Muse Glimmer. The move positions Meta against closed-model rivals OpenAI and Anthropic and against Chinese open-weight labs like DeepSeek and Alibaba.
Meta Releases Muse Glimmer 30B, an On-Device Agentic Model with Built-In Perception Encoder
Meta Superintelligence Lab has released Muse Glimmer, a 29.6-billion-parameter multimodal model distilled from Muse Spark for autonomous agentic tasks that run entirely on consumer hardware. The Apache 2.0-licensed model ships with a dedicated perception encoder, 131K+ token context, and speculative decoding for local speedups up to 3.1x.
Comments
Loading...