local inference

Nace AI has open-sourced Drex Max v1, a 27B multimodal decision model. MarkTechPost reports it scores 67.52 and runs locally on Apple Silicon.

Liquid AI has published LFM3-1.7B-GGUF on Hugging Face, a GGUF version of LFM3-1.7B for local inference on CPUs and GPUs. The Q4_0 file is a Quantization-Aware Distillation checkpoint trained to recover the accuracy lost to Q4_0 quantization.

Hugging Face released Carbon-X, a 14-billion-parameter open model that takes DNA sequences and English questions and returns conversational answers. It was trained on 300 billion tokens and is designed to run locally. Its developers say it has not yet been validated with wet lab experiments.

Meta released Muse Spark Open, an 800-billion-parameter open-weight model, on October 15, 2026. It is optimized for Apple's M5 Ultra Mac Studio and needs roughly 1TB of memory to run locally. Meta claims it outperforms GLM 5.3 and Kimi K3 on agentic tasks and visual reasoning.

Unsloth has published GGUF quantizations of Muse Glimmer-30B, a dense 29.6B-parameter causal transformer with a dedicated perception encoder, attributed to Meta Superintelligence Lab in the model card. The model targets autonomous agentic tasks on consumer hardware with a 131,072-token context window and 4-bit quantization under 20GB.

Ollama v0.32.7 adds support for Muse Glimmer, a 30B-parameter multimodal model that Meta describes as the first release from its new Meta Superintelligence Labs division. Initial support runs through Ollama's MLX engine on Apple Silicon, with NVIDIA and AMD support promised in the coming days.

Google launched AI Edge Gallery for macOS, allowing Mac users to run Google's Gemma models locally. The platform ships with five Gemma models, including the newly released Gemma 4 12B—a 12-billion-parameter multimodal model that handles text, vision, and audio while running on consumer laptops with 16GB of RAM.