SGLang

Liquid AI has released LFM2.5-VL-3B-DSpark, a 280M-parameter speculative decoding drafter for its LFM2.5-VL-3B vision-language model. The company claims decode speedups up to 3.13x on Apple silicon and 2.66x on H100 GPUs, with day-one support for llama.cpp, MLX-VLM, and SGLang.

Liquid AI released DSpark draft model checkpoints for three LFM2.5 models, enabling speculative decoding that speeds up inference by up to 3.18x on H100 GPUs and 2.87x on-device, with day-one support for llama.cpp and SGLang.