edge AI
7 articles tagged with edge AI
Liquid AI releases open d1-3B decision model: 16 ms on Jetson AGX Thor, 48.57 on Decision Index
Liquid AI released two open-weight decision models, d1-3B (text and image) and the experimental d1-omni-600M (text with image or audio). Unlike generative models, they answer in a single forward pass, and Liquid AI claims d1-3B scores 48.57 on its Decision Index 0.2.1, ahead of all 4B and 9B models it tested.
Cactus Compute Releases Needle 3, a Sub-30MB On-Device Model for Tool Calling and Extraction
Cactus Compute has released Needle 3, a foundation model compressed to 8-29 MB that runs entirely on-device for tool calling, structured data extraction, and text embedding. The company claims it beats models 10x its size on mobile tool calls while running on hardware as small as microcontrollers.
Liquid AI Releases LFM2.5-VL-3B, a 3.1B-Parameter Vision-Language Model for On-Device Inference
Liquid AI has released LFM2.5-VL-3B, a 3.1-billion-parameter vision-language model built for on-device deployment. The model claims leading performance in its size class on grounding, screen understanding, and tool use, while running at 228 tokens/s on an Apple M5 Max.
Liquid AI Releases LFM2.5-2.6B, a 2.6B-Parameter Agent Model for On-Device Deployment
Liquid AI has released LFM2.5-2.6B, a 2.6B-parameter model designed to run capable tool-calling agents locally on laptops and phones. The company claims it matches or beats models up to 4x its size on instruction-following and tool-use benchmarks while running under 2.5GB of memory.
NASA Runs Google's Gemma 3 Aboard Orbiting Satellite for On-Board Image Analysis
NASA's Jet Propulsion Laboratory ran a 4-bit quantized version of Google's Gemma 3 4B on board a Loft Orbital YAM-9 satellite, marking the first in-orbit demonstration of a vision-language model analyzing imagery from a satellite's own sensor. The unmodified open-weights model hit 88 percent accuracy on a 7,960-image benchmark and ran live capture tests over Toulouse, France and coastal Argentina.
Liquid AI releases LFM2.5-230M, a 230M parameter edge model running at 213 tok/s on Galaxy S25 Ultra
Liquid AI has released LFM2.5-230M, a 230M parameter hybrid model trained on 19 trillion tokens with a 32,768 token context window. The model achieves 213 tok/s decode speed on Galaxy S25 Ultra and 42 tok/s on Raspberry Pi 5, with support for function calling and data extraction tasks.
Liquid AI Releases LFM2.5-8B: 8-Billion Parameter Hybrid Model Optimized for Edge Deployment
Liquid AI has released LFM2.5-8B-A1B, an 8-billion parameter hybrid model designed specifically for edge AI and on-device deployment. The model is available in multiple GGUF quantized formats ranging from 4-bit (4.84 GB) to 16-bit (16.9 GB), optimized for memory efficiency.