NVIDIA releases LocateAnything-3B vision-language model with 2.5× faster object detection via parallel box decoding
NVIDIA released LocateAnything-3B, a 3-billion parameter vision-language model that predicts bounding boxes in parallel rather than token-by-token, achieving up to 2.5× higher throughput compared to autoregressive approaches. The model, trained on 12M images with 138M+ queries and 785M bounding boxes, supports object detection, GUI element grounding, and robotics perception.
LocateAnything-3B — Quick Specs
NVIDIA releases LocateAnything-3B vision-language model with 2.5× faster object detection via parallel box decoding
NVIDIA released LocateAnything-3B, a 3-billion parameter vision-language model designed for fast visual grounding tasks including object detection, GUI element localization, and robotics perception.
Technical specifications
The model uses Qwen2.5-3B-Instruct as its language backbone and MoonViT-SO-400M as its vision encoder. Training data spans 12 million images, 138 million queries, and 785 million bounding boxes across natural scenes, robotics, driving, GUI interaction, and document understanding domains.
Input supports images up to 2.5K resolution and text prompts up to 24K tokens. The model can generate up to 8,192 new tokens during inference and uses BF16 precision with KV cache.
Parallel Box Decoding innovation
LocateAnything's core technical contribution is Parallel Box Decoding (PBD), which predicts complete bounding box coordinates in a single parallel step instead of generating coordinates token-by-token autoregressively. According to NVIDIA, this approach delivers up to 2.5× higher throughput while preserving geometric consistency.
The architecture outputs structured coordinate tokens in fixed-length blocks of 6 tokens, including semantic labels, box coordinates, and control tokens. The model supports three decoding modes: Fast Mode (parallel prediction), Slow Mode (autoregressive), and Hybrid Mode (parallel with autoregressive fallback).
Supported use cases
NVIDIA lists these supported applications:
- Open-set and long-tail object detection
- Dense multi-object detection in cluttered scenes
- Phrase and referring-expression grounding
- Automated dataset labeling
- GUI element grounding for agentic systems
- Robotics and autonomous driving perception
- Document understanding and OCR localization
- Industrial inspection and surveillance
The model has been integrated into NVIDIA's Nemotron 3 Nano Omni production models for grounding and multimodal capabilities.
Availability and licensing
LocateAnything-3B is available on Hugging Face and GitHub as of May 26, 2026. The model is released under NVIDIA's non-commercial license, permitting use only for academic and non-profit research. Commercial use is prohibited except by NVIDIA and its affiliates.
The model runs on NVIDIA Ampere, Hopper, Blackwell, and Lovelace architectures. TensorRT and TensorRT-LLM support is not yet available. Deployment on embedded platforms like NVIDIA Thor requires additional optimization including quantization or distillation.
What this means
Parallel Box Decoding represents a practical efficiency gain for visual grounding tasks that require detecting multiple objects or UI elements in a single image. The 2.5× throughput improvement matters for real-time applications like robotics and GUI automation where latency compounds across multiple API calls. However, the non-commercial license limits this to research settings, and the model's integration into production Nemotron systems suggests NVIDIA views visual grounding as infrastructure for agentic AI systems rather than standalone capability. The 3B parameter size makes local deployment feasible on consumer GPUs while the multi-domain training data indicates this is positioned as a generalist localization model rather than domain-specific detector.
Related Articles
Mistral AI Releases Shieldstral-1.0-3B, a 3B-Parameter Policy-Adaptive Safety Classifier
Mistral AI has released Shieldstral-1.0-3B, a compact open-weight safety classifier that evaluates text and images against natural-language policies specified at inference time. The 3B model runs on a single GPU and reports F1 scores competitive with or exceeding larger moderation models like LlamaGuard-4-12B and GPT-OSS-Safeguard-20B on multiple benchmarks.
NVIDIA Releases Nemotron VoiceChat 11B, an Open Full-Duplex Speech Model with Live Tool Calling
NVIDIA has released NemotronLabs VoiceChat 11B, an 11-billion-parameter end-to-end full-duplex speech model that unifies streaming speech understanding and generation in one architecture. The model claims to be the first open full-duplex system to support live tool calling during natural conversation, with ~450ms turn-taking latency.
Mistral Releases Shieldstral, a 3B Open-Weights Safety Classifier That Matches Models 7x Its Size
Mistral has released Shieldstral, a 3B open-weights safety classifier that reframes content moderation as a policy-adaptive question-answering task. The model claims to match or outperform guard models up to 7x its size on text safety and multimodal benchmarks, and runs on a single 16GB GPU.
Google DeepMind Launches Gemini Robotics 2, a Single VLA Model for Arms to Humanoids
Google DeepMind has introduced Gemini Robotics 2, a vision-language-action model it calls its most advanced yet, designed to control everything from tabletop robot arms to full-body humanoids. The company also released Gemini Robotics ER 2, an embodied reasoning model that replaces ER 1.6.
Comments
Loading...