PrismML releases Bonsai 27B, claims first 27B-parameter model to run on-device on iPhone at 4GB memory footprint
PrismML has released Bonsai 27B, claiming it's the first 27-billion parameter model capable of running on-device on iPhone. The model achieves 58-87 tokens per second on Apple's M5 Max chip with a 4GB memory footprint, using 1-bit and ternary quantization to fit within iPhone's approximately 6GB available app memory.
PrismML releases Bonsai 27B, claims first 27B-parameter model to run on-device on iPhone at 4GB memory footprint
PrismML has released Bonsai 27B, claiming it's the first 27-billion parameter model capable of running natively on iPhone. The model achieves approximately 4GB memory footprint through aggressive quantization, fitting within the roughly 6GB of memory iPhones make available to apps.
Performance specifications
According to PrismML, Bonsai 27B reaches:
- M5 Max (Apple Silicon): Up to 87 tokens/second in 1-bit mode, 58 tokens/second in ternary mode
- NVIDIA GeForce RTX 5090: Up to 163 tokens/second in 1-bit mode, 134 tokens/second in ternary mode
The company states the model runs natively on Mac, iPhone, and iPad via MLX, and on NVIDIA GPUs via CUDA through custom low-bit kernels built for its hybrid-attention architecture.
On-device constraints
PrismML explains that running models on iPhone faces stricter constraints than storage alone. A 12GB iPhone provides approximately 6GB of memory available for apps, which must be shared between the model weights, KV cache, and activations. The company claims conventional 27B model builds don't approach this threshold, while the 1-bit Bonsai 27B at approximately 4GB is "the first to pass through with room to work."
Availability and Apple discussions
The model is released under Apache 2.0 License with weights available today. PrismML is offering a limited-time free developer preview API.
PrismML CEO Babak Hassibi told CNBC that Apple and other companies are evaluating the startup's models for speed, energy efficiency, and on-device performance. "They're really evaluating our technology right now," Hassibi said of Apple, characterizing discussions as "very early" with unclear outcomes. Apple has not commented.
The Information first reported last week that PrismML held meetings with Apple about potential uses of its technology.
What this means
If PrismML's claims hold, Bonsai 27B represents a significant advance in model compression for mobile deployment. However, the company provides no benchmark scores for quality or accuracy compared to standard 27B models, making it impossible to assess performance trade-offs from the aggressive quantization. The public discussions about Apple talks appear designed to generate launch buzz—serious partnership negotiations typically remain confidential. Independent testing will be needed to verify both the on-device performance claims and whether the model maintains useful capability at 1-bit and ternary quantization levels.
Related Articles
Tencent Open-Sources Hy4 Preview: 770B-Parameter MoE Model with 1M-Token Context
Tencent's Hy Team has open-sourced Hy4 preview, a 770-billion-parameter Mixture-of-Experts model with 49 billion activated parameters and a 1-million-token context window. The model is available under Apache 2.0 alongside an FP8-quantized variant, with Tencent claiming it beats GLM 5.3 and Kimi K3 on internal engineering evaluations.
Tencent Releases Hy4 Preview: 770B-Parameter MoE Model with 1M Context for Coding Agents
Tencent has released Hy4 preview, a mixture-of-experts model with 770B total parameters and 49B active parameters, targeting coding agents and multi-step tool-use workflows. The model ships with a 1 million token context window and is priced at $0.834 per 1M input tokens and $2.501 per 1M output tokens.
Google Launches Gemini 3.5 Transcribe with 4.0% Word Error Rate Across 85 Languages
Google has released Gemini 3.5 Transcribe, a speech-to-text model that automatically detects 85 languages, removes filler words, and corrects misspoken phrases. The company claims a 4.0 percent word error rate for streaming audio and 70 percent lower latency than its predecessor, Chirp 3.
Z.ai's GLM-5.3-Flash Matches Top Models at 7.5x Lower Cost, Runs Entirely on Chinese Chips
Z.ai released GLM-5.3-Flash, a 320-billion-parameter MoE model with an 18-billion active parameter count and a one-million-token context window. It nearly matches the larger GLM-5.3 on Artificial Analysis's Intelligence Index while costing roughly 7.5 times less per task, and it reportedly runs entirely on Chinese AI chips instead of Nvidia GPUs.
Comments
Loading...