Liquid AI launches RIPL, a real-time inference engine for LFM models, with 14.4 to 28.4x lower p95 latency
Liquid AI released RIPL, a real-time inference engine for its LFM models. On a single B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM.
Liquid AI has released RIPL, a real-time inference engine for its LFM models. On one B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM, according to a report from MarkTechPost.
What was announced
RIPL is an inference engine, not a new model. It serves Liquid AI's LFM family, and MarkTechPost's headline describes it as built for sub-50 ms LFMs.
Reported performance
The figures come from the MarkTechPost report:
- Hardware: one B200
- Model on RIPL: LFM2.5-1.2B
- Comparison: Qwen3.5-0.8B on vLLM
- Metric: p95 latency
- Result: 14.4 to 28.4x lower p95 latency for LFM2.5-1.2B on RIPL
The comparison pairs different models on different serving stacks, so the result reflects the combination of model and engine rather than the engine alone.
Pricing, context window and availability details for RIPL are not covered in the report.
What this means
Liquid AI is releasing serving software for its LFM models alongside the models themselves. The reported result uses p95 latency, a tail-latency measure that matters for real-time applications. Because the benchmark compares LFM2.5-1.2B on RIPL against Qwen3.5-0.8B on vLLM, teams evaluating RIPL should test it on their own workloads and hardware before drawing conclusions about the engine itself.
Related Articles
Deepseek open-sources DeepInfer, the Apache 2.0 inference engine behind its V4.1-Flash model
Deepseek has open-sourced DeepInfer, the internal inference framework that serves its V4.1-Flash model, under the Apache License 2.0. The company says it will also open-source code for future models and has released deepseek-recipe to reproduce its API's token processing in self-hosted setups.
Liquid AI Publishes GGUF Builds of LFM2.5-24B-A2B, Including a 13.6 GB Quantization-Aware Q4_0 Checkpoint
Liquid AI has published GGUF builds of LFM2.5-24B-A2B, a 24B-parameter model on the lfm2moe architecture, in sizes from 13.6 GB (Q4_0) to 48 GB (BF16). The Q4_0 file is a Quantization-Aware Distillation checkpoint trained to recover accuracy lost to 4-bit quantization.
Liquid AI releases LFM2.5-24B-A2B: open-weight 24B reasoning MoE with 2B active parameters and 131K context
Liquid AI released LFM2.5-24B-A2B, an open-weight reasoning mixture-of-experts model with 24B total and 2B active parameters and a 131K-token context window. The company claims it is competitive with Qwen3.6-35B-A3B on agentic and tool-use tasks while decoding at 184 tokens/s on an Apple M5 Max.
OpenAI opens Decisions API to all customers, cutting latency to 100-180 ms on a reconfigured ChatGPT Luna
OpenAI made its Decisions API available to all customers on Thursday, running a reconfigured ChatGPT Luna that returns choices with confidence ratings in 100 to 180 milliseconds, according to OpenAI. The service competes with TypeSafe's Jev, which ranks higher on two public decision-model indices.
Comments
Loading...