SGLang
9 articles tagged with SGLang
Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license
Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.
inclusionAI releases SingProbe, an 8.13M-parameter streaming guardrail for Ling-3.1-flash-1019
inclusionAI published Ling-3.1-flash-1019-singprobe, an 8.13M-parameter probe that reads three hidden-state layers of Ling-3.1-flash-1019 and scores query intent, response unsafety and hallucination risk at each generated token. The model card reports a response safety F1 of 0.8707 and a hallucination AUC of 0.8041.
Tencent releases Hy4 flash weights in three variants under a custom license with revenue and user caps
Tencent has released downloadable weights for Hy4 flash in three variants: instruction-tuned, FP8 and base. The checkpoints ship under Tencent Hy License 1.0, which requires a separate license above US$50 million in revenue or 100 million monthly active users. Tencent says the larger Hy4 model's weights are still being prepared.
MiniMax releases MiniMax-H3-Image-PE, a prompt-expansion model fine-tuned from Qwen3.8-27B in FP4
MiniMax has released MiniMax-H3-Image-PE on Hugging Face, a prompt-expansion model for MiniMax-H3-Image. The weights are fine-tuned from Qwen3.8-27B in FP4 and turn a short request into a detailed image description plus an aspect-ratio recommendation.
Tencent releases DSpine draft model for Qwen3.8-27B: 16-token blocks, up to 3.84× agent speedup over autoregressive deco
Tencent has published Qwen3.8-27B-DSpine-b16, a five-layer draft model with a 16-token block size and an 8,192-token sliding window, under Apache 2.0. According to its model card, it beats DFlash2 on acceptance length across five general benchmarks and on end-to-end agent throughput in SGLang.
inclusionAI releases Ling-3.1-flash-1019: 560B MoE, 25B active, 1M-token context
inclusionAI has released Ling-3.1-flash-1019, a post-training upgrade of Ling-3.1-flash with 560B total parameters, 25B active per token, and a 1M-token context window. The company reports a score of 44 on the Artificial Analysis Intelligence Index v4.3.2, up from 41 for its predecessor.
Baidu releases Unlimited-OCR-2, using SR-SWA to parse documents of unbounded length in a finite context window
Baidu released Unlimited-OCR-2 on 2026-10-27. It introduces Sparse Reference Sliding Window Attention (SR-SWA), which Baidu says keeps per-step decoding latency and memory nearly constant regardless of document length. Baidu claims state-of-the-art results on MPDocBench and MarathonDocBench.
Liquid AI Releases DSpark Draft Model for LFM2.5-VL-3B, Claims Up to 3.13x Decode Speedup
Liquid AI has released LFM2.5-VL-3B-DSpark, a 280M-parameter speculative decoding drafter for its LFM2.5-VL-3B vision-language model. The company claims decode speedups up to 3.13x on Apple silicon and 2.66x on H100 GPUs, with day-one support for llama.cpp, MLX-VLM, and SGLang.
Liquid AI Ships DSpark Draft Models, Cutting LFM2.5 Inference Latency Up to 3.18x on GPU
Liquid AI released DSpark draft model checkpoints for three LFM2.5 models, enabling speculative decoding that speeds up inference by up to 3.18x on H100 GPUs and 2.87x on-device, with day-one support for llama.cpp and SGLang.