Liquid AI Releases LFM2.5-8B: 8-Billion Parameter Hybrid Model Optimized for Edge Deployment
Liquid AI has released LFM2.5-8B-A1B, an 8-billion parameter hybrid model designed specifically for edge AI and on-device deployment. The model is available in multiple GGUF quantized formats ranging from 4-bit (4.84 GB) to 16-bit (16.9 GB), optimized for memory efficiency.
Liquid AI Releases LFM2.5-8B: 8-Billion Parameter Hybrid Model Optimized for Edge Deployment
Liquid AI has released LFM2.5-8B-A1B, an 8-billion parameter hybrid model designed specifically for edge AI and on-device deployment. The company claims the model "sets a new standard in terms of quality, speed, and memory efficiency."
Technical Specifications
The model features an LFM2MoE architecture and is available in multiple GGUF quantized formats:
- 4-bit Q4_0: 4.84 GB
- 4-bit Q4_K_M: 5.16 GB
- 5-bit Q5_K_M: 6.03 GB
- 6-bit Q6_K: 6.96 GB
- 8-bit Q8_0: 9.01 GB
- 16-bit BF16/F16: 16.9 GB
The quantization range allows developers to balance model size against performance based on deployment constraints. The smallest 4-bit version requires under 5 GB of storage, making it viable for mobile and edge devices.
Deployment and Availability
The model runs via llama.cpp, the widely-used inference framework for quantized language models. According to Hugging Face data, the model has been downloaded 42 times in its first month of availability.
LFM2.5-8B-A1B is a fine-tuned version built on top of LiquidAI/LFM2.5-8B-A1B-Base. The model is part of a collection of 33 post-trained and base LFM2.5 models released by Liquid AI.
No pricing information has been disclosed for API access. The model is not currently deployed by any inference provider on Hugging Face's platform.
Architecture Details
The LFM2MoE architecture suggests a mixture-of-experts approach, though specific architectural details beyond the 8-billion parameter count have not been published. The "2" in LFM2 indicates this is the second generation of Liquid AI's hybrid models.
What This Means
Liquid AI is targeting the growing edge AI market with a model sized between typical small models (1-3B parameters) and larger general-purpose models (70B+). The 8B parameter count and aggressive quantization options suggest the company is prioritizing deployment flexibility over raw capability. However, without published benchmark scores or detailed performance comparisons, it's unclear how LFM2.5-8B compares to established edge-optimized models like Llama 3.2 3B or Phi-3.5-mini. The availability of GGUF formats makes the model immediately compatible with the broader llama.cpp ecosystem.
Related Articles
GLM-5.3-Flash Debuts as Zhipu AI's First Natively Multimodal Model, 320B Parameters with 18B Active
Zhipu AI has released GLM-5.3-Flash, the first natively multimodal model in its GLM-5 series, built on a 320B-parameter mixture-of-experts architecture with only 18B active parameters. The company claims it outperforms GLM-5.2 while approaching Claude Opus 4.8 on coding and agentic benchmarks at a fraction of the cost. Unsloth has published quantized GGUF versions for local inference.
Qwen3.8-Flash-Next Debuts with 125B-Parameter Hybrid Architecture, Previews Qwen4 Design
Qwen3.8-Flash-Next is an experimental preview of the architecture Alibaba's Qwen team plans to use for Qwen4, combining hybrid attention, gated residuals, and n-gram embeddings in a 125B-parameter model with only 6B activated per token. Unsloth has released Dynamic 3.0 GGUF quantizations for local inference.
Tencent Open-Sources Hy4 Preview: 770B-Parameter MoE Model with 1M-Token Context
Tencent's Hy Team has open-sourced Hy4 preview, a 770-billion-parameter Mixture-of-Experts model with 49 billion activated parameters and a 1-million-token context window. The model is available under Apache 2.0 alongside an FP8-quantized variant, with Tencent claiming it beats GLM 5.3 and Kimi K3 on internal engineering evaluations.
Tencent Releases Hy4 Preview: 770B-Parameter MoE Model with 1M Context for Coding Agents
Tencent has released Hy4 preview, a mixture-of-experts model with 770B total parameters and 49B active parameters, targeting coding agents and multi-step tool-use workflows. The model ships with a 1 million token context window and is priced at $0.834 per 1M input tokens and $2.501 per 1M output tokens.
Comments
Loading...