Perplexity Launches Hybrid Compute for Mac, Splitting AI Tasks Between Cloud and Local Models
Perplexity's Mac app now supports Hybrid Compute, which starts tasks in the cloud and shifts sensitive steps to a local model running on-device. The feature requires Apple silicon with at least 24GB of unified memory and uses an open-sourced on-device PII classifier to mask private data before any cloud processing.
Perplexity has launched Hybrid Compute, a new feature in its Mac app that splits AI tasks between cloud models and a local model running on-device. The rollout follows an initial announcement of the work in June and arrives after Apple featured Perplexity's Personal Computer app as a productivity use case for the new M6 Mac mini.
How it works
According to Perplexity, its "Computer" assistant now starts each task in the cloud but can shift to a local model for steps that touch private files or sensitive data. A task triggered from an iPhone, for example, can hand off to the Mac to access local files and complete sensitive processing without that data leaving the device.
Privacy protection is handled by an on-device PII classifier that scans each task before anything is sent to the cloud. Names, addresses, and account numbers are replaced with placeholder values, then restored once the cloud model returns its answer. Perplexity says it developed the classifier with its Secure Intelligence Institute and has open-sourced it, though the company has not published independent benchmark data verifying its accuracy at detecting or masking personal information.
Hardware requirements
Hybrid Compute only runs on Apple silicon Macs with macOS 15 or later. Perplexity sets 24GB of unified memory as the minimum requirement and recommends 32GB for best results — meaning Macs with 8GB or 16GB of RAM cannot run the feature at all. This effectively limits Hybrid Compute to higher-end MacBook Pro, Mac Studio, and upper-tier Mac mini configurations.
Setup requires a one-click download of what Perplexity calls "PPLX Qwen 3.8 27B," a local model built on Alibaba's Qwen 3.8 architecture at 27 billion parameters. Perplexity says the process requires no manual runtime configuration or third-party tools like Ollama. Tasks handled entirely by the local model consume no cloud credits and require no API key, according to the company.
What this means
Hybrid Compute is a product feature, not a new foundation model — the underlying local component is a repackaged version of an existing Qwen checkpoint, not a Perplexity-trained model from scratch. Its real significance is architectural: Perplexity is betting that a split-execution model, where sensitive data never leaves the device while general reasoning still runs in the cloud, becomes a meaningful differentiator as AI assistants gain deeper access to personal files.
The 24GB memory floor is a hard constraint that excludes a large share of the existing Mac installed base, including every base-model MacBook Air and many entry Mac mini configurations sold in the past two years. That narrows Hybrid Compute's near-term audience to higher-end hardware buyers — likely by design, since Apple's own promotion of Perplexity alongside the M6 Mac mini suggests the two companies are coordinating on positioning higher-memory Macs as AI-capable machines. Whether the open-sourced PII classifier holds up to independent scrutiny will determine if this privacy pitch is substantive or largely marketing.
Related Articles
Google releases free AI Edge Foresight, a Mac note-taking app that transcribes meetings fully offline
Google has released AI Edge Foresight, a free experimental macOS app that transcribes meetings and audio files entirely on-device. It is optimized for Apple Silicon Macs and uses Google's EmbeddingGemma 2 model, according to The Verge. Google says audio, files, and notes never leave the user's computer.
NVIDIA releases 96 GiB NVFP4 build of Qwen3.8-Flash-Next for single-GPU Blackwell and DGX Spark
NVIDIA has published Qwen3.8-Flash-Next-FP4-Local, a 96 GiB NVFP4 quantization of Alibaba's 125B-parameter MoE model, on Hugging Face. NVIDIA reports 91.5% on GPQA Diamond versus 92.2% for BF16. It requires NVIDIA's custom vLLM containers because upstream support has not landed.
Liquid AI Publishes GGUF Builds of LFM2.5-24B-A2B, Including a 13.6 GB Quantization-Aware Q4_0 Checkpoint
Liquid AI has published GGUF builds of LFM2.5-24B-A2B, a 24B-parameter model on the lfm2moe architecture, in sizes from 13.6 GB (Q4_0) to 48 GB (BF16). The Q4_0 file is a Quantization-Aware Distillation checkpoint trained to recover accuracy lost to 4-bit quantization.
Hugging Face Transformers v5.20.1 adds Reflection AI's Beam model and fixes loading on older torch
Hugging Face's Transformers v5.20.1 adds Beam, a model from Reflection AI that the release notes describe as token-efficient, frontier-scale, and aimed at coding and agentic work. The patch also fixes a regression that broke model loading on older torch versions. Beam's specifications and pricing were not disclosed in the release notes.
Comments
Loading...