product update

Perplexity Computer adds hybrid inference to split tasks between local and cloud models

TL;DR

Perplexity announced that its Computer agentic system will gain hybrid inference in July 2026, automatically splitting tasks between local models for sensitive data and cloud-based frontier models for complex operations. The feature aims to balance privacy with computational power without requiring manual model selection.

2 min read
0

Perplexity Computer adds hybrid inference to split tasks between local and cloud models

Perplexity announced that its Computer agentic system will gain the ability to automatically split tasks between on-device and cloud-based models in July 2026.

The hybrid inference feature allows Perplexity Computer to route different parts of a single task to appropriate models: sensitive data processing stays on local models running on the user's device, while complex operations requiring frontier model capabilities run on cloud servers.

How hybrid agentic inference works

According to Perplexity, a compact model running locally determines which data should remain on-device. The system then coordinates between local and cloud execution for different parts of the same task.

Perplexity positions this as solving a key problem with current AI systems: "Unlike tools that ask you to pick local or cloud up front, this happens on its own, task by task."

The company cites use cases involving financial records, health information, and personal files as scenarios where users need both privacy and powerful AI capabilities.

Technical details

Perplexity claims the hybrid approach "maximizes token efficiency" by routing work to appropriate compute resources. The announcement did not specify which local models will run on-device, what minimum hardware requirements exist, or which frontier models will handle cloud-side processing.

No pricing changes were announced for the feature, which will be available to Perplexity Computer subscribers.

Availability

The hybrid agentic inference capability will launch in July 2026 for Perplexity Computer on Mac. The company has not announced plans for other platforms.

Perplexity Computer, the company's agentic AI system, launched earlier in 2026 as a Mac-native platform for subscribers of Perplexity's paid service.

What this means

This represents a practical approach to the privacy-versus-capability tradeoff in AI applications. By automating the decision of what runs where, Perplexity aims to eliminate a manual step that many users lack the technical knowledge to handle. The success of this approach depends on the accuracy of the local model's routing decisions and the actual performance difference users experience compared to cloud-only execution. If the local routing logic proves reliable, this could become a standard architecture for privacy-sensitive AI applications.

Related Articles

product update

OpenAI restores chat sidebar in Mac app after user backlash over confusing redesign

OpenAI has updated its ChatGPT Mac app to restore direct access to chat conversations through a prominent sidebar toggle. The fix addresses user complaints following a July 10 redesign that replaced the native Mac client with an Electron-based app and buried the standard chat interface behind Work and Codex features.

product update

OpenRouter Launches Auto Router Beta: Task-Aware Model Routing Based on Community Spend

OpenRouter has released Auto Router Beta, a task-aware routing system that classifies incoming requests and automatically routes them to popular models based on community spending patterns. The router allows users to filter selections by cost-quality tradeoff preferences.

product update

NVIDIA NeMo Automodel integrates with Hugging Face Diffusers for distributed video and image model fine-tuning

NVIDIA and Hugging Face have integrated NeMo Automodel with the Diffusers library, enabling distributed fine-tuning of video and image diffusion models without checkpoint conversion. The integration supports models including FLUX.1-dev (12B), Wan 2.1 (1.3B/14B), and HunyuanVideo (13B) with full fine-tuning and LoRA options.

product update

AWS launches Managed Knowledge Base for Bedrock with 6 enterprise connectors and automatic ACL enforcement

Amazon Web Services launched Managed Knowledge Base for Bedrock in general availability, offering a fully managed retrieval solution with six native enterprise connectors including SharePoint, Confluence, and Google Drive. The service handles document parsing up to 500 MB for PDFs, 2 GB for audio, and 10 GB for video, with real-time access control list verification at query time.

Comments

Loading...