PrismML releases Bonsai 27B, claims first 27B-parameter model to run on-device on iPhone at 4GB memory footprint
PrismML has released Bonsai 27B, claiming it's the first 27-billion parameter model capable of running on-device on iPhone. The model achieves 58-87 tokens per second on Apple's M5 Max chip with a 4GB memory footprint, using 1-bit and ternary quantization to fit within iPhone's approximately 6GB available app memory.
PrismML releases Bonsai 27B, claims first 27B-parameter model to run on-device on iPhone at 4GB memory footprint
PrismML has released Bonsai 27B, claiming it's the first 27-billion parameter model capable of running natively on iPhone. The model achieves approximately 4GB memory footprint through aggressive quantization, fitting within the roughly 6GB of memory iPhones make available to apps.
Performance specifications
According to PrismML, Bonsai 27B reaches:
- M5 Max (Apple Silicon): Up to 87 tokens/second in 1-bit mode, 58 tokens/second in ternary mode
- NVIDIA GeForce RTX 5090: Up to 163 tokens/second in 1-bit mode, 134 tokens/second in ternary mode
The company states the model runs natively on Mac, iPhone, and iPad via MLX, and on NVIDIA GPUs via CUDA through custom low-bit kernels built for its hybrid-attention architecture.
On-device constraints
PrismML explains that running models on iPhone faces stricter constraints than storage alone. A 12GB iPhone provides approximately 6GB of memory available for apps, which must be shared between the model weights, KV cache, and activations. The company claims conventional 27B model builds don't approach this threshold, while the 1-bit Bonsai 27B at approximately 4GB is "the first to pass through with room to work."
Availability and Apple discussions
The model is released under Apache 2.0 License with weights available today. PrismML is offering a limited-time free developer preview API.
PrismML CEO Babak Hassibi told CNBC that Apple and other companies are evaluating the startup's models for speed, energy efficiency, and on-device performance. "They're really evaluating our technology right now," Hassibi said of Apple, characterizing discussions as "very early" with unclear outcomes. Apple has not commented.
The Information first reported last week that PrismML held meetings with Apple about potential uses of its technology.
What this means
If PrismML's claims hold, Bonsai 27B represents a significant advance in model compression for mobile deployment. However, the company provides no benchmark scores for quality or accuracy compared to standard 27B models, making it impossible to assess performance trade-offs from the aggressive quantization. The public discussions about Apple talks appear designed to generate launch buzz—serious partnership negotiations typically remain confidential. Independent testing will be needed to verify both the on-device performance claims and whether the model maintains useful capability at 1-bit and ternary quantization levels.
Related Articles
AllSpark's Iris-mini and Iris-pro Top Open-Weight Search Agent Benchmarks
Chinese lab AllSpark has released Iris-mini and Iris-pro, two open-weight search agents built on Qwen3 models that claim the top spot among open-weight systems in their size classes on four research benchmarks. The release includes model weights, an agent harness, and evaluation code, with training pipelines to follow.
Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model
Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.
Google Releases TimesFM-3, a 330M-Parameter Model That Forecasts Sales Using Weather and Discount Data
Google Research has released TimesFM-3, a 330-million-parameter time series forecasting model that predicts outcomes like sales by combining related variables, historical data, and known future events such as discounts or weather. The model claims top rankings on three benchmarks against Amazon's Chronos-2 and the Toto-2.0 family.
DeepSeek Ships V4.1-Flash With Novel Encoder-Decoder Architecture, Cuts KV Cache to 1/8 of Predecessor
DeepSeek released V4.1-Flash, a 763B-parameter model built on a new causal encoder-decoder architecture that splits 8B active parameters for prefill and 16B for decode. The model adds native vision support, a 1M-token context window, and shrinks KV cache footprint to roughly 1/8 of DeepSeek V4 Flash, while retiring V4 Pro.
Comments
Loading...