on-device
12 articles tagged with on-device
Underdog Woof, a 40.6 MB two-voice TTS model, claims 1.42% word error rate on a CPU
Underdog Woof is an English text-to-speech model with two voices, Juno and Mira, packaged as a single 40.6 MB file that runs on a CPU with numpy. Underdog reports a 1.42% word error rate for Mira on Gradium TTS Hard Cases, against 1.89% for Fish Audio Drama 3, a 41.5 GB download.
Gradium says Phonon on-device TTS passed 200,000 downloads in two weeks
Gradium reported on November 5, 2026 that its Phonon on-device text-to-speech models have been downloaded more than 200,000 times in their first two weeks. The company says Phonon ranked first for intelligibility in German and Spanish on the Open TTS Leaderboard.
Preferred Networks opens PLaMo 3 Translate weights in four sizes, 0.8B to 31B
Preferred Networks released PLaMo 3 Translate, a translation-specialized LLM, as open weights on November 5 in four sizes: 0.8B, 2B, 8B and 31B. The company claims world-class translation performance and says even the smallest model outperforms Google's TranslateGemma and Tencent's Hy-MT2.
Block's AI lab releases Dessa, a full-duplex speech-to-speech model that runs on a MacBook Pro M4 Max
Block's AI lab released Dessa, a full-duplex speech-to-speech model trained only on human conversation audio. It runs locally on a MacBook Pro M4 Max, according to MarkTechPost.
Gradium open-sources Phonon 31m, a 31M-parameter on-device TTS model under Apache 2.0
Gradium has open-sourced Phonon, a family of on-device text-to-speech models. The English Phonon 31m has 31M parameters, ships under Apache 2.0, fits in 64.5 MB, and starts speaking in about 7 ms on a laptop CPU.
PrismML releases Bonsai 27B, claims first 27B-parameter model to run on-device on iPhone at 4GB memory footprint
PrismML has released Bonsai 27B, claiming it's the first 27-billion parameter model capable of running on-device on iPhone. The model achieves 58-87 tokens per second on Apple's M5 Max chip with a 4GB memory footprint, using 1-bit and ternary quantization to fit within iPhone's approximately 6GB available app memory.
Liquid AI Releases LFM2.5-8B: 8-Billion Parameter Hybrid Model Optimized for Edge Deployment
Liquid AI has released LFM2.5-8B-A1B, an 8-billion parameter hybrid model designed specifically for edge AI and on-device deployment. The model is available in multiple GGUF quantized formats ranging from 4-bit (4.84 GB) to 16-bit (16.9 GB), optimized for memory efficiency.
Supertone releases Supertonic 3: 99M-parameter on-device TTS model supporting 31 languages
Supertone has released Supertonic 3, a 99M-parameter text-to-speech model that runs entirely on-device using ONNX Runtime. The model expands language support from 5 to 31 languages compared to Supertonic 2, requires no GPU, and claims competitive accuracy against models 7-20x larger.
Google DeepMind Releases Gemma 4 E4B with Multi-Token Prediction for 2x Faster Inference
Google DeepMind released the Gemma 4 E4B assistant model using Multi-Token Prediction (MTP) architecture that accelerates inference by up to 2x through speculative decoding. The 4.5B effective parameter model supports 128K context windows and handles text, image, and audio input with pricing not yet disclosed.
Zyphra Releases ZAYA1-8B: 8.4B Parameter MoE Model with 760M Active Parameters Matches 80B+ Models on Math Benchmarks
Zyphra has released ZAYA1-8B, a mixture-of-experts language model with 760M active parameters and 8.4B total parameters. The model scores 89.1% on AIME 2026, competitive with models exceeding 100B parameters, while maintaining efficiency for on-device deployment.
Google DeepMind releases Gemma 4 with 31B dense model, 256K context window, and speculative decoding drafters
Google DeepMind has released Gemma 4, a family of open-weight multimodal models including a 31B dense model with 256K context window and four size variants ranging from 2.3B to 30.7B effective parameters. The release includes Multi-Token Prediction (MTP) draft models that achieve up to 2x decoding speedup through speculative decoding while maintaining identical output quality.
PrismML releases 1-bit Bonsai 8B model, claims 14x smaller and 5x more energy efficient than full-precision peers
PrismML, a Caltech-founded startup, has released Bonsai 8B, a 1-bit quantized large language model that the company claims is 14x smaller and 5x more energy efficient than full-precision counterparts while remaining competitive with standard 8B models. The model fits into 1.15GB of memory and uses a novel 1-bit weight representation (binary signs with shared scale factors per weight group) instead of traditional 16-bit or 32-bit precision.