model releaseTencent
Tencent Releases Hy3: 295B-Parameter MoE Model with 21B Active Parameters at 256K Context
Tencent has released Hy3, a 295-billion parameter Mixture-of-Experts model with 21 billion active parameters and 3.8 billion MTP layer parameters. The model features a 256K context window and is released under Apache 2.0 license, with pricing not yet disclosed.
2 min read