product update

NASA Runs Google's Gemma 3 Aboard Orbiting Satellite for On-Board Image Analysis

TL;DR

NASA's Jet Propulsion Laboratory ran a 4-bit quantized version of Google's Gemma 3 4B on board a Loft Orbital YAM-9 satellite, marking the first in-orbit demonstration of a vision-language model analyzing imagery from a satellite's own sensor. The unmodified open-weights model hit 88 percent accuracy on a 7,960-image benchmark and ran live capture tests over Toulouse, France and coastal Argentina.

3 min read
0

NASA's Jet Propulsion Laboratory has run Google's Gemma 3 large language model in orbit, achieving what the agency describes as the first in-orbit demonstration of a vision-language model analyzing imagery captured by a satellite's own sensor.

The system, called NAVI-Orbital, deployed a 4-bit quantized version of Gemma 3 4B — Google's open-weights model, the same one available for download on Hugging Face — aboard a YAM-9 satellite built by Loft Orbital. No fine-tuning or additional training was performed on the model before or during the mission.

How it works

NAVI-Orbital is an agentic software framework built by NASA JPL's Juan M. Delfa and Taran Cyriac John alongside Loft Orbital's Andrew W. Herson. It uses a LangGraph-based conductor to coordinate operations and runs Gemma 3 to produce plain-text descriptions of satellite imagery.

On the ground, before launch, the system was benchmarked against a dataset of 7,960 images and reached 88 percent classification accuracy, according to the research team's paper. In orbit, NASA conducted two live capture tests — one over Toulouse, France, and another over the coast of Argentina — prompting Gemma 3 with scripted questions about whether images showed commercial or residential areas, or natural features.

The model ran on an Nvidia Jetson Orin AGX, a low-power compute module common in robotics applications. The 4-bit, 4-billion-parameter model requires only 8GB of memory, according to Delfa, which is what made it feasible to run on the satellite's hardware. YAM-9 itself carries a compute cluster of radiation-hardened FPGAs, CPUs, and GPUs shared across multiple customer payloads, powered by solar panels generating between 150 and 500 watts depending on orbital position.

Why bandwidth matters

Paul Lasserre, general manager at Loft Orbital, called the approach a form of "semantic compression." Rather than downlinking full-resolution images — which can run into the hundreds of megabytes — a satellite using this approach can transmit a text summary instead, at a fraction of the data size.

"It doesn't matter if the link is slow, because you're downlinking dozens of kilobytes instead of dozens or hundreds of megabytes," Lasserre said.

Delfa pointed to wildfire detection as a practical example. Current satellite-based wildfire detection can face delays of up to 90 minutes due to downlink bandwidth and ground-based processing constraints, according to research cited by the team. An on-board model capable of flagging a fire directly could, in theory, cut that delay significantly — though NASA has not yet demonstrated this specific use case in orbit.

Not yet flying the spacecraft

NAVI-Orbital is deliberately isolated from flight software; it reads images and generates descriptions but has no access to spacecraft controls. Delfa frames the demonstration as a shift in how researchers interact with orbiting hardware. Retargeting the system for a new task — say, searching for wildfires instead of classifying land use — requires only editing a text prompt rather than rewriting, retraining, and revalidating onboard software, according to Delfa.

Delfa also said the NAVI framework was conceived partly as groundwork for AI companions that could assist astronauts operating under the physical constraints of a spacesuit, though this application remains conceptual.

What this means

This is a narrow but concrete proof of concept, not a leap toward autonomous spacecraft. The notable technical fact is that an unmodified, publicly downloadable 4-billion-parameter model — quantized to 4-bit precision and run on commodity edge hardware — performed useful classification work in orbit without any space-specific retraining. That lowers the bar for future orbital AI deployments considerably, since mission teams won't necessarily need custom-trained models for every new sensor or target type.

The bandwidth argument is the more immediately practical one: most satellites are downlink-constrained, and swapping megabyte-scale images for kilobyte-scale text descriptions is a real operational advantage regardless of how sophisticated the underlying model is. Whether 88 percent accuracy is good enough for operational use — wildfire detection, disaster response, or defense applications — will depend heavily on the cost of false negatives in each use case, something this demonstration doesn't resolve.

Related Articles

product update

Gemini Overlay on Android Adds Minimize Button for Multitasking Bubble

Google is widely rolling out a new Minimize button for the Gemini overlay on Android, which collapses conversations into a floating bubble users can drag or tap to expand. The feature currently supports six fixed positions and has a reported bug that resets bubble placement after each minimization.

product update

Google's Gemini Spark Agent Gains Ability to Manage Google Photos Libraries

Google announced that Gemini Spark, its personal AI agent, can now execute tasks directly inside Google Photos—editing images, curating albums, and turning flyers into calendar events. The rollout begins over the next few weeks for Gemini AI Pro and Ultra subscribers in the U.S.

product update

Google Rolls Out Gemini Spark Control Over Google Photos for Automated Editing and Sharing

Google is extending Gemini Spark's agentic control to Google Photos, enabling automated photo curation, editing, album creation, and sharing through natural-language multi-step commands. The rollout begins this week for Google AI Pro and Ultra subscribers in the US.

product update

Google Launches Pics, a Prompt-Based Design Tool Built Into Workspace

Google is launching Pics, an AI image creation and editing tool powered by its Nano Banana model, positioning it as a prompt-first alternative to Canva and Adobe Express. The tool rolls out first in Google Docs and Slides for Workspace and Google AI Pro/Ultra subscribers, with Drive support to follow.

Comments

Loading...