Tencent Releases Hy-MT2: 1.8B Translation Model Compressed to 440MB With 1.25-Bit Quantization
Tencent has open-sourced Hy-MT2, a family of multilingual translation models available in 1.8B, 7B, and 30B-A3B parameter sizes. The models support translation across 33 languages and include extreme quantization down to 1.25-bit, reducing the 1.8B model to 440MB storage while increasing inference speed by 1.5x.
Hy-MT2-1.8B at a glance
Tencent Releases Hy-MT2: 1.8B Translation Model Compressed to 440MB With 1.25-Bit Quantization
Tencent has open-sourced Hy-MT2, a family of multilingual translation models designed for complex real-world scenarios, released on May 21, 2025. The family includes three model sizes: 1.8B, 7B, and 30B-A3B (mixture-of-experts architecture).
Model Specifications
All three models support translation among 33 languages and can follow translation instructions in multiple languages. The 1.8B base model is available in multiple quantization formats:
- Standard FP8 quantization
- GGUF format for llama.cpp deployment
- 2-bit quantization
- 1.25-bit extreme quantization via AngelSlim
The 1.25-bit quantization reduces storage requirements to just 440MB and improves inference speed by 1.5x compared to the unquantized version, according to Tencent.
Performance Claims
Tencent claims the 7B and 30B-A3B models outperform open-source models including DeepSeek-V4-Pro and Kimi K2.6 in "fast-thinking mode." The company states the lightweight 1.8B model surpasses mainstream commercial translation APIs from Microsoft and Doubao (ByteDance's service) overall.
The models were evaluated across general translation, real-world business scenarios, domain-specific tasks, and instruction-following capabilities. Tencent has released IFMTBench, a new benchmark specifically for evaluating translation instruction-following performance.
Inference Configuration
For the 1.8B and 7B models, Tencent recommends:
- Temperature: 0.7
- Top-p: 0.6
- Top-k: 20
- Repetition penalty: 1.05
- Max tokens: 4096
The 30B-A3B model uses different parameters: top-p of 1.0, top-k of -1, and no repetition penalty.
Deployment and Training
The models support deployment via transformers (version 5.6.0+), vLLM, and SGLang. Tencent provides a complete training pipeline supporting both full-parameter fine-tuning and LoRA fine-tuning with DeepSpeed ZeRO configurations and LLaMA-Factory integration.
The company has also released Hy-MT2-Translator Skill for easier integration of the model series into translation workflows.
WMT26 Partnership
Tencent announced an official partnership with WMT26 (Workshop on Machine Translation) for the "Video Subtitle Translation Task." Participants using Hy-MT models in the general machine translation and video subtitle translation tasks are eligible for special awards sponsored by Hunyuan.
All models are available on HuggingFace and ModelScope. Pricing for API access has not been disclosed.
What This Means
The 1.25-bit quantization achieving 440MB storage is notable for on-device deployment scenarios where model size is a critical constraint. However, Tencent's performance claims require independent verification—benchmarks against commercial APIs like Microsoft Translator need reproducible methodology. The partnership with WMT26 suggests Tencent is positioning these models for academic credibility in addition to commercial deployment. The extreme quantization approach, if validated, could enable translation models on resource-constrained devices that previously couldn't run models of this capability level.
Related Articles
AngelSlim publishes five GGUF builds of Hy4-flash, smallest at 125.73 GiB
AngelSlim has published five GGUF builds of tencent/Hy4-flash, a 223B-parameter model, with the smallest at 125.73 GiB. Speed tests cover a Mac M5 Max 128GB and an RTX Spark 128GB, and llama.cpp support still requires an unmerged pull request.
Tencent Hy team says next model will be substantially larger, with Flash-Lite and 24GB-class options planned
Tencent's Hy team said in a public Reddit AMA that its next model will be substantially larger and that it will keep investing in large-scale reinforcement learning. It also described Flash-Lite, Hy4-mini and models for 24GB GPUs as roadmap items, not released products.
Tencent opens WorkBuddy Computer Use beta for Windows and macOS apps that lack APIs
Tencent announced a public beta of WorkBuddy's Computer Use feature on November 20. It lets the office agent operate desktop applications that have no API, connector or browser version, on Windows and macOS, and requires WorkBuddy client 5.11.0 or later.
Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license
Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.
Comments
Loading...