product updateLiquid AI

Liquid AI launches RIPL, a real-time inference engine for LFM models, with 14.4 to 28.4x lower p95 latency

TL;DR

Liquid AI released RIPL, a real-time inference engine for its LFM models. On a single B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM.

1 min read
0

Liquid AI has released RIPL, a real-time inference engine for its LFM models. On one B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM, according to a report from MarkTechPost.

What was announced

RIPL is an inference engine, not a new model. It serves Liquid AI's LFM family, and MarkTechPost's headline describes it as built for sub-50 ms LFMs.

Reported performance

The figures come from the MarkTechPost report:

  • Hardware: one B200
  • Model on RIPL: LFM2.5-1.2B
  • Comparison: Qwen3.5-0.8B on vLLM
  • Metric: p95 latency
  • Result: 14.4 to 28.4x lower p95 latency for LFM2.5-1.2B on RIPL

The comparison pairs different models on different serving stacks, so the result reflects the combination of model and engine rather than the engine alone.

Pricing, context window and availability details for RIPL are not covered in the report.

What this means

Liquid AI is releasing serving software for its LFM models alongside the models themselves. The reported result uses p95 latency, a tail-latency measure that matters for real-time applications. Because the benchmark compares LFM2.5-1.2B on RIPL against Qwen3.5-0.8B on vLLM, teams evaluating RIPL should test it on their own workloads and hardware before drawing conclusions about the engine itself.

Related Articles

product update

Deepseek open-sources DeepInfer, the Apache 2.0 inference engine behind its V4.1-Flash model

Deepseek has open-sourced DeepInfer, the internal inference framework that serves its V4.1-Flash model, under the Apache License 2.0. The company says it will also open-source code for future models and has released deepseek-recipe to reproduce its API's token processing in self-hosted setups.

product update

Liquid AI Publishes GGUF Builds of LFM2.5-24B-A2B, Including a 13.6 GB Quantization-Aware Q4_0 Checkpoint

Liquid AI has published GGUF builds of LFM2.5-24B-A2B, a 24B-parameter model on the lfm2moe architecture, in sizes from 13.6 GB (Q4_0) to 48 GB (BF16). The Q4_0 file is a Quantization-Aware Distillation checkpoint trained to recover accuracy lost to 4-bit quantization.

model release

Liquid AI releases LFM2.5-24B-A2B: open-weight 24B reasoning MoE with 2B active parameters and 131K context

Liquid AI released LFM2.5-24B-A2B, an open-weight reasoning mixture-of-experts model with 24B total and 2B active parameters and a 131K-token context window. The company claims it is competitive with Qwen3.6-35B-A3B on agentic and tool-use tasks while decoding at 184 tokens/s on an Apple M5 Max.

product update

OpenAI opens Decisions API to all customers, cutting latency to 100-180 ms on a reconfigured ChatGPT Luna

OpenAI made its Decisions API available to all customers on Thursday, running a reconfigured ChatGPT Luna that returns choices with confidence ratings in 100 to 180 milliseconds, according to OpenAI. The service competes with TypeSafe's Jev, which ranks higher on two public decision-model indices.

Comments

Loading...