local inference

Meta released Muse Glimmer, a 30B-parameter open-weight model under Apache 2.0 built for always-on local agents, alongside a promise to release Muse Spark 1.2 weights soon. The model runs on a single RTX 3090 and scores 35 on Artificial Analysis's Intelligence Index.

Unsloth has published GGUF quantizations of Muse Glimmer-30B, a dense 29.6B-parameter causal transformer with a dedicated perception encoder, attributed to Meta Superintelligence Lab in the model card. The model targets autonomous agentic tasks on consumer hardware with a 131,072-token context window and 4-bit quantization under 20GB.

Ollama v0.32.7 adds support for Muse Glimmer, a 30B-parameter multimodal model that Meta describes as the first release from its new Meta Superintelligence Labs division. Initial support runs through Ollama's MLX engine on Apple Silicon, with NVIDIA and AMD support promised in the coming days.

Google launched AI Edge Gallery for macOS, allowing Mac users to run Google's Gemma models locally. The platform ships with five Gemma models, including the newly released Gemma 4 12B—a 12-billion-parameter multimodal model that handles text, vision, and audio while running on consumer laptops with 16GB of RAM.