Alibaba Qwen Releases 35B Language World Model for Agent Environment Simulation Across 7 Domains
Alibaba's Qwen team released Qwen-AgentWorld-35B-A3B, a 35 billion parameter language world model designed for agentic environment simulation. The model covers seven domains—MCP tool calling, Search, Terminal, Software Engineering, Android, Web, and OS—in a single model with a 262,144 token context window.
Qwen-AgentWorld-35B-A3B at a glance
Alibaba Qwen Releases 35B Language World Model for Agent Environment Simulation
Alibaba's Qwen team released Qwen-AgentWorld-35B-A3B, a 35 billion parameter language world model designed for agentic environment simulation. The model covers seven domains—MCP tool calling, Search, Terminal, Software Engineering, Android, Web, and OS—in a single model with a 262,144 token context window.
Architecture and Training
Qwen-AgentWorld-35B-A3B is built on Qwen3.5-35B-A3B-Base with 35 billion total parameters and 3 billion activated parameters using a Mixture of Experts (MoE) architecture. The model employs 256 experts with 8 activated experts plus 1 shared expert per layer.
According to Qwen, the model was trained through a three-stage pipeline: continual pre-training (CPT) to inject environment knowledge, supervised fine-tuning (SFT) to activate next-state-prediction reasoning, and reinforcement learning (RL) using GSPO to improve simulation fidelity. The team claims this makes it a "native world model" where environment modeling is the training objective from CPT onward, not a post-hoc adaptation.
The architecture uses 40 layers with a hidden dimension of 2048 and combines Gated DeltaNet and Gated Attention mechanisms. The model supports rotary position embeddings with dimension 64.
Benchmark Performance
On AgentWorldBench, Qwen-AgentWorld-35B-A3B achieved an overall score of 56.39 across seven domains, evaluated on five dimensions: Format, Factuality, Consistency, Realism, and Quality. This places it between GPT-4o (58.25) and Claude Opus 4.6 (57.80) in overall performance.
The model's strongest performance was in the MCP domain (64.79) and Software Engineering (65.63), while Search (36.69) and Web (49.55) showed lower scores. According to Qwen, the model demonstrates zero-shot generalization to out-of-domain environments and supports controllable perturbations.
Deployment and Usage
The model is available on Hugging Face and compatible with vLLM, SGLang, and Transformers. Qwen recommends running with a minimum context length of 128K tokens despite the 262K maximum, as the model leverages extended context for multi-turn environment simulation.
Recommended inference parameters are temperature=0.6, top_p=0.95, and top_k=20, with an output length of 32,768 tokens for most queries. The model uses a thinking mode by default (enclosed in <think>...</think> tags) to reason about environment state transitions before producing predictions.
Pricing information has not been disclosed. The model requires tensor parallelism across 4 GPUs for deployment.
What This Means
Qwen-AgentWorld represents a shift toward specialized models trained explicitly for agent simulation rather than repurposing general-purpose language models. The unified seven-domain approach in a single 35B parameter model suggests environment simulation may not require frontier-scale models, though performance still trails GPT-4o. The MoE architecture with only 3B activated parameters makes deployment more efficient than dense models of similar total size, potentially enabling faster local agent development workflows. Whether language world models become standard infrastructure for agent development will depend on whether simulated environments adequately replace real environment testing.
Related Articles
Cloudflare releases open-weight Clairic 27B and new Clairic-flash 9B for data extraction
Cloudflare announced on November 18, 2026 an updated 27-billion-parameter Clairic and a new 9-billion-parameter Clairic-flash. Both have open weights on Hugging Face and are available as hosted Workers AI endpoints.
OpenAI releases GPT-Live-1.1 in the API, with standby mode billing idle WebRTC time at $0.02 per minute
OpenAI has released GPT-Live-1.1 in the API. The full-duplex voice model improves multilingual accents and transcription, and a new standby mode bills idle WebRTC time at $0.02 per minute instead of $0.05.
Baseten releases open-weight bison-1 and groundhog-1 decision models; bison-1 scores 76 on AA Decision Index v2.1
Baseten released bison-1 and groundhog-1, two open-weight decision models built on Gemma 4. Bison-1 scores 76 on the AA Decision Index v2.1, and both models support 128k context and image input.
Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context
Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.
Comments
Loading...