multimodal

50 articles tagged with multimodal

September 22, 2026
model releaseXiaomi

Xiaomi Releases MiMo-V2.6-Pro-RL, a 1.02T-Parameter Omnimodal Model with 1M-Token Context

Xiaomi's MiMo team has released MiMo-V2.6-Pro-RL, a 1.02-trillion-parameter sparse mixture-of-experts model with 42B active parameters, 1M-token context, and native text/image/video/audio processing. The model was trained via a single mixed reinforcement learning run spanning coding, agentic, visual, and cybersecurity tasks, with benchmark scores that Xiaomi claims approach or match Claude Opus 5 and GPT-5.6 on several agentic and coding tests.

September 21, 2026
model releaseXiaomi

Xiaomi Launches MiMo-V2.6-Pro-UltraSpeed: Same Quality, 10x Faster Output

Xiaomi's MiMo-V2.6-Pro-UltraSpeed is a fast-inference edition of the company's 1T-parameter flagship MiMo-V2.6-Pro, delivering roughly 10x the output speed at matching quality. It retains the 1M-token context window and native multimodal capabilities, priced at $4.35/$8.70 per 1M input/output tokens.

model releaseXiaomi

Xiaomi Releases MiMo-V2.6-Flash: Open-Source MoE Model with 1M-Token Context, $0.14/$0.28 per 1M Tokens

Xiaomi has released MiMo-V2.6-Flash, an open-source Mixture-of-Experts model with 309B total parameters and 15B activated per token, featuring a 1M-token context window and native multimodal capabilities. Priced at $0.14 per 1M input tokens and $0.28 per 1M output tokens, it targets agentic coding and long-horizon task workflows.

model releaseXiaomi

Xiaomi Launches MiMo-V2.6-Pro, a 1T+ Parameter Model with 1M-Token Context

Xiaomi has released MiMo-V2.6-Pro, a flagship foundation model exceeding 1 trillion parameters with a 1M-token context window and native multimodal support. The model is priced at $0.435 per 1M input tokens and $0.87 per 1M output tokens, targeting agentic and long-horizon tasks.

September 18, 2026
model release

Z.ai Releases GLM-5.3-FlashX, a 200 Tokens/Second Variant of Its GLM-5.3-Flash Model

Z.ai has released GLM-5.3-FlashX, a high-speed variant of GLM-5.3-Flash built on a hybrid sparse and linear attention architecture with 320B total parameters (18B active). The model supports a 1M-token context window and claims inference speeds of up to 200 tokens per second.

September 15, 2026
model releaseGoogle DeepMind

Google DeepMind Launches Gemini 3.8 Live, Claims #1 Spot on Speech-to-Speech Benchmark

Google DeepMind has released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking, two voice-dialogue models that reason and execute background tasks without interrupting conversation. Google claims the Extended Thinking model ranks #1 on Artificial Analysis' Speech to Speech Quality Index with a score of 82.6.

September 11, 2026
model releaseOpenAI

Unverified 'GPT Astra' Model Appears on OpenRouter With 1.05M Token Context, No OpenAI Confirmation

OpenRouter is listing a model called 'OpenAI GPT Astra Latest' with a 1.05 million token context window and $10/$50 per-million-token pricing. OpenAI has made no public announcement, and the listing's own description says it is an auto-redirecting alias rather than a fixed model.

model releaseOpenAI

OpenRouter Lists 'GPT Sol Latest' — An Alias Pointer to OpenAI's Newest Sol-Family Model, Not a Standalone Release

OpenRouter has added a listing called '~openai/gpt-sol-latest,' described as an alias that always points to the newest model in an undisclosed 'GPT Sol' family from OpenAI. The listing shows a 1050K token context window and pricing of $2.00 per million input tokens and $10.00 per million output tokens, but OpenAI has not publicly confirmed a model line by this name.

September 5, 2026
model release

Alibaba Releases Qwen3.8 Max (0902), a 2.4-Trillion-Parameter MoE Model With 1M-Token Context

Alibaba's Qwen team released Qwen3.8 Max (0902), a 2.4-trillion-parameter mixture-of-experts model with a 1M-token context window that accepts text, image, and video input. The snapshot is post-trained for coding, agentic workflows, and long-horizon task execution, priced at $2/$6 per 1M input/output tokens.

September 2, 2026
model release

Meta Releases Muse Spark 1.3 Contributor, a Low-Cost Multimodal Reasoning Model With 1M Context Window

Meta has released Muse Spark 1.3 Contributor, described as the cost-efficient contributor tier of its multimodal reasoning model line. The model offers a 1 million token context window at $0.10 per 1M input tokens and $0.20 per 1M output tokens, targeting experimentation and early-stage agentic workflows.

model release

Meta Releases Muse Spark 1.3, a Free Multimodal Reasoning Model with 1M-Token Context

Meta has released Muse Spark 1.3, a multimodal reasoning model with a 1M-token context window, listed as free on OpenRouter. The model targets long-running agentic, multi-agent, and coding workflows, though audio input support remains incomplete.

product update

OpenRouter Adds Auto-Updating Alias for Zhipu AI's GLM Flash Model Family

Z.ai has published GLM Flash Latest on OpenRouter, a routing alias that automatically points to the newest checkpoint in the GLM Flash lineup. It supports a 1.31M token context window and multimodal text, image, and video input at $0.07 per 1M input tokens and $0.25 per 1M output tokens.

August 31, 2026
model releaseDeepSeek

DeepSeek Releases V4-Flash-Vision-Exp, First Multimodal Model in V4 Family

DeepSeek has released DeepSeek-V4-Flash-Vision-Exp, its first experimental multimodal model in the V4 family, adding visual understanding to the V4-Flash architecture. The 305B-parameter model shows substantial gains on multimodal agent benchmarks while holding steady on text-only tasks.

August 27, 2026
model release

GLM-5.3-Flash Debuts as Zhipu AI's First Natively Multimodal Model, 320B Parameters with 18B Active

Zhipu AI has released GLM-5.3-Flash, the first natively multimodal model in its GLM-5 series, built on a 320B-parameter mixture-of-experts architecture with only 18B active parameters. The company claims it outperforms GLM-5.2 while approaching Claude Opus 4.8 on coding and agentic benchmarks at a fraction of the cost. Unsloth has published quantized GGUF versions for local inference.

model release

Z.ai Launches GLM-5.3-Flash: 1M-Token Context, Image Support, Claimed 10x Cost Cut Over GLM-5.2

Z.ai has released GLM-5.3-Flash, a 320-billion-parameter Mixture-of-Experts model with 18 billion active parameters, a 1-million-token context window, and image input support. The model launched on LM Studio's Bionic platform hours after its official unveiling, with LM Studio claiming it is 9-10x cheaper to run than GLM-5.2.

August 26, 2026
model release

Alibaba Releases Qwen3.8 Flash, a Multimodal Reasoning Model with 1M-Token Context

Alibaba has released Qwen3.8 Flash, a multimodal reasoning model with a 1 million token context window, aimed at coding, agentic workflows, and visual/document analysis. It's priced at $0.16 per 1M input tokens and $0.47 per 1M output tokens through Alibaba Cloud International.

changelogHugging Face

Hugging Face Transformers v5.16.1 Adds Support for GLM-5.3-Flash, a 320B-Parameter Multimodal MoE Model

Hugging Face's transformers v5.16.1 release adds support for GLM-5.3-Flash, a 320B total-parameter (18B active) multimodal mixture-of-experts model. Zhipu AI claims it outperforms GLM-5.2 while approaching Claude Opus 4.8 on coding and agentic benchmarks at one-tenth the cost.

model release

Z.ai Launches GLM-5.3-Flash With 1M-Token Context and Hybrid Attention Architecture

Z.ai has released GLM-5.3-Flash, a native multimodal model built for coding and long-horizon agent tasks, featuring a 1M-token context window and a hybrid sparse-linear attention architecture. The model is available via OpenRouter at a discounted $0.075/$0.25 per 1M tokens through September 2026.

August 25, 2026
model release

SenseNova Releases U1.5-8B-MoT, an Open-Weight Unified Model for Image Generation and Editing

SenseNova has released SenseNova-U1.5-8B-MoT, an open-weight native multimodal model built on its NEO-unify architecture for image generation, editing, and native 4K output. The model is available on Hugging Face under an Apache 2.0 license, with no inference pricing yet since it must be self-hosted.

August 21, 2026
model releaseDeepSeek

DeepSeek Releases Experimental V4-Flash-Vision-Exp, Claims Near-Parity With Opus 4.8 on Agent Benchmarks

DeepSeek has released V4-Flash-Vision-Exp, an experimental multimodal extension of V4-Flash that adds image understanding while preserving text reasoning capabilities. The company claims the model approaches or beats Anthropic's Opus 4.8 on its internal multimodal agent benchmarks.

model releaseDeepSeek

DeepSeek Releases V4 Flash Vision Exp, an Experimental Multimodal MoE Model with 1M Context

DeepSeek has released V4 Flash Vision Exp, an experimental vision-enabled variant of DeepSeek V4 Flash 0731 that adds image understanding while matching the base model's text performance. The sparse mixture-of-experts model uses 13B active parameters out of 284B total and supports a 1M token context window.

August 15, 2026
model release

Qwen Launches Qwen3.8 27B, an Open-Weight Vision-Language Model with 262K Context

Qwen has released Qwen3.8 27B, a 27-billion-parameter dense vision-language model with a 262K token context window, available now via OpenRouter at $0.45 per million input tokens and $3.20 per million output tokens.

August 14, 2026
model releaseLiquid Ai

Liquid AI Releases LFM2.5-VL-3B, a 3B-Class Vision-Language Model Built for On-Device Deployment

Liquid AI has released LFM2.5-VL-3B, a multimodal upgrade to its LFM2-VL-3B model built for on-device grounding, object detection, and document OCR. The model runs at 228 tokens/sec on an Apple M5 Max and 116 tokens/sec on an AMD Ryzen AI Max+ 395, using under 3.3 GB of memory.

August 12, 2026
model releaseByteDance

ByteDance Seed Launches Seed 2.1 Turbo, a 262K-Context Multimodal Model for Coding Agents

ByteDance Seed has released Seed 2.1 Turbo, a multimodal model targeting coding and long-horizon agent workflows with a 262K token context window. The model is priced at $0.50 per 1M input tokens and $2.50 per 1M output tokens, and is now listed on OpenRouter.

August 10, 2026
model release

Meta Releases Muse Glimmer 30B, an On-Device Agentic Model with Built-In Perception Encoder

Meta Superintelligence Lab has released Muse Glimmer, a 29.6-billion-parameter multimodal model distilled from Muse Spark for autonomous agentic tasks that run entirely on consumer hardware. The Apache 2.0-licensed model ships with a dedicated perception encoder, 131K+ token context, and speculative decoding for local speedups up to 3.1x.

model release

Ollama Adds Support for Meta's 30B "Muse Glimmer" Model, First Release from Meta Superintelligence Labs

Ollama v0.32.7 adds support for Muse Glimmer, a 30B-parameter multimodal model that Meta describes as the first release from its new Meta Superintelligence Labs division. Initial support runs through Ollama's MLX engine on Apple Silicon, with NVIDIA and AMD support promised in the coming days.

model release

Meta Releases Muse Glimmer, a 30B Multimodal Model Distilled for Local Agentic Use

Meta has released Muse Glimmer, a 30B parameter multimodal model distilled from its larger Muse model, designed for local, privacy-aware agentic applications. The model ships under the Apache 2.0 license as part of Hugging Face Transformers v5.15.0, which also adds support for IBM's GraniteSWA/GraniteMoeSWA and the A.X-K1/K2 models.

August 5, 2026
model releaseMistral AI

Mistral AI Releases Shieldstral-1.0-3B, a 3B-Parameter Policy-Adaptive Safety Classifier

Mistral AI has released Shieldstral-1.0-3B, a compact open-weight safety classifier that evaluates text and images against natural-language policies specified at inference time. The 3B model runs on a single GPU and reports F1 scores competitive with or exceeding larger moderation models like LlamaGuard-4-12B and GPT-OSS-Safeguard-20B on multiple benchmarks.

August 4, 2026
model release

Mistral Releases Shieldstral, a 3B Open-Weights Safety Classifier That Matches Models 7x Its Size

Mistral has released Shieldstral, a 3B open-weights safety classifier that reframes content moderation as a policy-adaptive question-answering task. The model claims to match or outperform guard models up to 7x its size on text safety and multimodal benchmarks, and runs on a single 16GB GPU.

July 29, 2026
model releaseMicrosoft

Microsoft Releases Mage-VL, a 4B-Parameter Codec-Native Streaming Vision-Language Model

Microsoft has released Mage-VL, a codec-native multimodal foundation model built on a from-scratch 4B-parameter visual encoder paired with Qwen3-4B-Instruct-2507. The model claims up to 3.5x inference speedup over uniform frame sampling and outperforms Qwen3-VL-4B on video and temporal-grounding benchmarks, according to Microsoft.

model release

Unsloth Releases GGUF Quantizations of Kimi K3, a 2.8T-Parameter Open-Weight MoE Model

Unsloth has released GGUF quantizations of Kimi K3, a 2.8-trillion-parameter open-weight Mixture-of-Experts model from Moonshot AI with a 1-million-token context window and native vision support. The largest lossless quantization (Q8) weighs in at 1.56TB.

July 25, 2026
model releaseMicrosoft

Microsoft Releases Fara1.5-27B, a 27B Vision-Only Web Browsing Agent with 262K Context

Microsoft Research AI Frontiers has released Fara1.5-27B, a 27-billion-parameter multimodal agent that completes web tasks by reading screenshots and emitting click/type/scroll commands. The model, fine-tuned from Qwen3.5-27B, ships under MIT license with a 262K-token context window and is designed to run alongside Microsoft's MagenticLite sandbox.

July 20, 2026
model release

Alibaba releases Qwen 3.8, a 2.4 trillion parameter open-weight model claiming second place behind Fable 5

Alibaba has released Qwen 3.8, a 2.4 trillion parameter open-weight model that the company claims trails only Fable 5. The multimodal model processes images, videos, and documents, with a preview available through Alibaba's platforms at 10 percent of standard pricing.

model release

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimo

Thinking Machines Lab released Inkling, a mixture-of-experts model with 975B total parameters and 41B active parameters, trained on 45 trillion tokens across text, images, audio, and video. The Apache 2.0-licensed model supports up to 1M context and debuts alongside Inkling-Small (276B-A12B), marking what observers call the strongest US-based open-weight release to date.

model release+1

Alibaba previews Qwen3.8 with 2.4 trillion parameters, claims second place without benchmark data

Alibaba unveiled Qwen3.8 at the World Artificial Intelligence Conference in Shanghai, claiming the 2.4 trillion parameter model ranks second only to Anthropic's Fable 5. The company provided no benchmark scores, model card, or independent verification to support the claim.

July 16, 2026
model release

Thinking Machines Lab releases Inkling: 975B-parameter open-weights multimodal model under Apache-2.0

Thinking Machines Lab released Inkling, a Mixture-of-Experts transformer with 975B total parameters and 41B active parameters, trained on 45 trillion tokens of text, images, audio and video. The Apache-2.0 licensed model is designed as a base for fine-tuning rather than a frontier model.

model releaseMoonshot AI

Moonshot AI Releases Kimi K3: Open-Weight Multimodal Reasoning Model with 1M Context Window

Moonshot AI has released Kimi K3, an open-weight multimodal reasoning model with a 1-million token context window. The model is priced at $3 per 1M input tokens and $15 per 1M output tokens, available through OpenRouter.

July 14, 2026
model release

Google releases Gemma 4 E2B, optimized to run natively on Pixel 10's Tensor G5 TPU

Google has released Gemma 4 E2B for TPU, a variant of its open-source Gemma 4 model optimized to run natively on the Tensor G5 chip in Pixel 10 devices. The multimodal model enables completely offline AI chat, image recognition, and audio transcription on Pixel 10, 10 Pro, 10 Pro XL, and 10 Pro Fold.

July 9, 2026
model releaseNVIDIA

NVIDIA Releases Audex-30B-A3B: Unified Audio-Text Model With 1M Token Context and Speech Generation

NVIDIA released Audex-30B-A3B, a unified audio-text model built on the Nemotron-Cascade-2-30B-A3B backbone. The model handles audio understanding, speech recognition and translation, text-to-speech, audio generation, and speech-to-speech while supporting up to 1M token context length.

July 8, 2026
model releaseOpenAI

OpenAI Launches GPT-Live Voice Model That Delegates Complex Tasks to GPT-5.5

OpenAI has replaced ChatGPT's voice mode with GPT-Live, a new voice model that can delegate complex tasks to GPT-5.5 in the background. The previous voice mode was based on a GPT-4o era model with a 2024 knowledge cutoff.

July 6, 2026
model releaseNex Agi

Nex AGI releases Nex-N2-Mini: open-source agentic MoE model with 262K context window

Nex AGI has released Nex-N2-Mini, an open-source agentic mixture-of-experts model with a 262K-token context window. The model accepts text and image inputs and is priced at $0.025 per 1M input tokens and $0.10 per 1M output tokens.

July 4, 2026
model releaseMistral AI

Mistral releases Leanstral 1.5: 119B parameter open-source model for Lean 4 proof assistance

Mistral AI has released Leanstral 1.5, an open-source 119B parameter mixture-of-experts model designed specifically for Lean 4 proof assistance. The model features 128 experts with 4 active per token (6.5B activated parameters), a 256k token context window, and multimodal input capabilities.

July 1, 2026
model release

Portugal releases Amália, open-source 9B parameter AI model trained on European Portuguese

Portugal has released Amália, its first national AI model trained specifically for European Portuguese. Built on EuroLLM-9B with 9 billion parameters, the model is fully open-source with weights, datasets, and code published under an open license. The government has committed €5.5m in initial funding through 2027.

June 30, 2026
model release

Google launches Gemini 3.1 Flash Lite Image with 4-second generation time, $0.25 per 1M input tokens

Google has released Gemini 3.1 Flash Lite Image, a text-to-image model that generates 1K resolution images in approximately 4 seconds — 2.7× faster than Gemini 3.1 Flash Image. The model is priced at $0.25 per 1M input tokens and $1.50 per 1M output tokens, with a 66K context window and knowledge cutoff of January 2025.

product update+1

Proton launches Lumo 2.0 with multimodal capabilities, scores 240% higher on AI benchmarks

Proton has released Lumo 2.0, adding image recognition and generation, encrypted memory features, and enhanced web search to its privacy-focused AI assistant. The company claims Lumo 2.0 Max scored 240% higher than version 1.4 on the Artificial Analysis Intelligence Index, while maintaining zero-access encryption and no conversation logging.

June 29, 2026
product updateAmazon Web Services

AWS demonstrates two-model pipeline using Nova 2 Lite and Claude Sonnet 4.6 that cuts document processing costs by 67%

AWS published a technical demonstration showing that pairing Amazon Nova 2 Lite with Anthropic's Claude Sonnet 4.6 reduces document processing costs by approximately two-thirds compared to single-model approaches. The two-stage pipeline processed 336 scanned yearbook pages at $0.0027 per page, producing 3,122 name-to-face associations with 93% scoring at or above 0.95 confidence.

June 24, 2026
product update

Google adds screen selection tool to Chrome's Gemini panel, integrates computer use into Gemini 3.5 Flash API

Google has added a screen selection tool to Chrome 149's Gemini panel that allows users to capture text or images from their current tab for prompts. Separately, the company integrated computer use capabilities directly into the Gemini 3.5 Flash model API, replacing the standalone Gemini 2.5 Computer Use model.

June 18, 2026
model releaseMistral AI

Mistral OCR 3 launches at $2 per 1,000 pages with 74% win rate over previous version

Mistral AI released Mistral OCR 3, a document extraction model priced at $2 per 1,000 pages ($1 with Batch API discount). The model achieves a 74% overall win rate over its predecessor on forms, scanned documents, complex tables, and handwriting according to internal benchmarks.

model releaseMistral AI

Mistral Releases Mistral 3 Family: 675B-Parameter Large 3 MoE and Three Edge Models Under Apache 2.0

Mistral has released Mistral 3, including Mistral Large 3—a sparse mixture-of-experts model with 41B active and 675B total parameters—and three Ministral 3 edge models (3B, 8B, 14B). All models are released under Apache 2.0 license with multimodal capabilities and are available today on multiple platforms.

product updateMistral AI

Mistral AI adds Deep Research agent, voice mode with Voxtral model to Le Chat

Mistral AI has released a major update to Le Chat, adding a Deep Research agent that generates structured research reports, a new voice input model called Voxtral, and Projects for organizing conversations. The update also includes multilingual reasoning powered by Mistral's Magistral model.