Tencent releases OmniWeaving, open-source video generation model with reasoning and multi-modal composition
Tencent's Hunyuan team released OmniWeaving on April 3, 2026, an open-source video generation model designed to compete with proprietary systems like Seedance-2.0. The model combines multimodal composition, reasoning-informed capabilities, and supports eight video generation tasks including text-to-video, image-to-video, video editing, and compositional generation.
Tencent Releases OmniWeaving, Open-Source Video Generation Model
Tencent's Hunyuan team released OmniWeaving on April 3, 2026, positioning it as an open-source alternative to closed proprietary video generation systems. The model represents a significant step toward unified video generation capabilities, supporting eight distinct task configurations.
Architecture and Technical Foundation
OmniWeaving is built on HunyuanVideo-1.5 as its backbone, integrating an MLLM (Multimodal Large Language Model) + MMDiT (Multimodal Diffusion Transformer) + VAE framework. The architecture incorporates two key improvements:
Thinking Mode: The MLLM activates a reasoning mode that generates intermediate reasoning steps before video generation, translating abstract user intent into semantically precise prompts that condition the diffusion model.
Hidden States DeepStacking: Following mechanisms in Qwen3-VL, the model extracts hidden states from multiple intermediate MLLM layers, capturing semantic information across fine-grained details to high-level abstractions. These multi-level features are injected into the first three layers of the MMDiT conditioning branch.
Supported Tasks
OmniWeaving supports eight video generation configurations:
- Text-to-Video: Generate videos from text prompts
- First-Frame-to-Video: Animate static images with text guidance
- Key-Frames-to-Video: Interpolate videos between start and end frames
- Video-to-Video Editing: Instruction-based manipulation and stylization
- Reference-to-Video: Single-subject reference-driven generation
- Compositional Multi-Image-to-Video: Multi-subject generation from 2–4 images
- Text-Image-Video-to-Video: Generation conditioned on combined text, image, and video inputs
- Reasoning-Augmented Generation: Reasoning over user intent before video generation
The reasoning and composition tasks can be optionally enabled via a --think flag during inference.
Benchmarking
Tencent introduced IntelligentVBench, described as the first comprehensive benchmark for assessing unified video generation with reasoning capabilities. According to the team, OmniWeaving achieves state-of-the-art performance among open-source unified video generation models, though specific benchmark scores were not disclosed in the release announcement.
Availability and Deployment
Code and model weights were released on April 3, 2026. The model requires installation of attention libraries for optimized inference:
- Flash Attention for faster inference and reduced GPU memory
- Flex-Block-Attention for sparse attention optimization
- SageAttention as an alternative optimization layer
The inference pipeline requires 8 GPUs by default but can be adapted for limited GPU memory environments through configuration adjustments and memory expansion settings. The codebase is available on GitHub with detailed checkpoint download instructions.
Research Background
OmniWeaving is the result of collaboration between Tencent Hunyuan, Zhejiang University, and Nanyang Technological University. The research was authored by Kaihang Pan, Qi Tian, and others, with the paper published on arXiv on March 26, 2026. The team trained the model on massive-scale pretraining datasets encompassing diverse compositional and reasoning-augmented scenarios.
What this means
OmniWeaving addresses a significant gap in open-source video generation by offering reasoning-aware composition capabilities previously limited to proprietary systems. The explicit integration of intermediate reasoning steps and multi-level semantic conditioning represents a technical approach to bridging user intent and pixel-level generation. For practitioners, this means access to a production-ready model supporting complex video generation workflows without closed-source dependencies. The IntelligentVBench benchmark provides a standardized evaluation framework for next-generation video models, though adoption depends on broader community adoption and reproducibility of claimed performance gains.
Related Articles
Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license
Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.
Tencent Hunyuan says Hy4 flash processed over 50 trillion tokens on its first day
Tencent's Hunyuan says Hy4 flash processed more than 50 trillion tokens on its first day after launching on November 16. The company says it is the highest first-day usage among models in the Hunyuan series.
Tencent Hy team says next model will be substantially larger, with Flash-Lite and 24GB-class options planned
Tencent's Hy team said in a public Reddit AMA that its next model will be substantially larger and that it will keep investing in large-scale reinforcement learning. It also described Flash-Lite, Hy4-mini and models for 24GB GPUs as roadmap items, not released products.
Tencent opens WorkBuddy Computer Use beta for Windows and macOS apps that lack APIs
Tencent announced a public beta of WorkBuddy's Computer Use feature on November 20. It lets the office agent operate desktop applications that have no API, connector or browser version, on Windows and macOS, and requires WorkBuddy client 5.11.0 or later.
Comments
Loading...