Reka AI releases Rho-1, a 19B-parameter omni-model for text, image, video and robot control
Reka AI has released a research preview of Rho-1, a 19-billion-parameter omni-model that processes and generates text, images, video, and robot control actions in a single network. Reka says it uses no tool calls or external models. Context window, pricing, and benchmark scores have not been disclosed.
Reka AI has released a research preview of Rho-1, a 19-billion-parameter omni-model that processes and generates text, images, video, and robot control actions within a single neural network, according to The Decoder's report on the release.
What Rho-1 does
Most multimodal systems route tasks to specialized models or call external tools. Rho-1 does neither, according to Reka. All modalities run as tokens in one shared context window, with no tool calls and no external models.
Reported capabilities:
- Continuous video generation in real time. The model generates video as a continuous stream.
- Live instruction updates. It responds to new instructions on the fly without restarting.
- Unified perception and control. The same weights that predict camera images also drive robot movements.
Training approach
Robot training data is scarce. To work around this, Reka built an inverse dynamics model that extracts control signals from ordinary internet videos. That lets the team use large volumes of unlabeled video as a source of action data.
Rho-1 was trained on 320 H100 GPUs over about three months. Assuming continuous use, that implies roughly 700,000 H100 GPU-hours. This is our estimate, not a figure Reka has published.
What has not been disclosed
The source material does not include:
- Context window size: not yet disclosed
- Pricing per 1M tokens: not yet disclosed
- Benchmark scores: none published in the source report
- Training data cutoff: not yet disclosed
- Weights, license, and API availability: not specified
The capability descriptions above, including real-time video generation and unified robot control, come from Reka. We have not seen independent evaluation.
Background
Reka AI is not new to multimodal work. In April 2024 it shipped Reka Core, a multimodal language model that, per the company at the time, competed with GPT-4, Claude 3, and Gemini Ultra on benchmarks. Rho-1 extends the company's focus from understanding multimodal inputs to generating video and actions.
The release fits a broader push in AI research toward so-called world models, which learn to predict and act within visual environments rather than only produce text.
What this means
The notable claim is architectural: one set of weights handling perception, video prediction, and motor control as tokens in a single context. If it holds up, it removes the orchestration layer that most robotics stacks need between a vision-language model and a low-level controller.
Two caveats apply. First, this is a research preview with no published benchmarks, so there is no way yet to compare Rho-1 against specialized robot policies or dedicated video generators. Second, a 19B-parameter model generating video in real time raises questions about latency, resolution, and hardware requirements that Reka has not answered publicly.
The inverse dynamics approach to mining internet video for control signals may prove the more durable contribution. It addresses the main bottleneck in robot learning, the shortage of action-labeled data, without large-scale teleoperation collection. Its quality depends on how accurately the inferred actions match real robot behavior, which independent testing will need to confirm.
Until Reka releases technical details, access terms, and evaluations, Rho-1 is best treated as a research signal rather than a deployable option.
Related Articles
Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license
Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.
Paradigm Intelligence launches Phai-A1 language model and Phai-M1 video model, trained on Huawei Ascend
Paradigm Intelligence (范式智能, formerly 第四范式) has unveiled two in-house models: Phai-A1, a language model that runs on a single RTX 3090, and Phai-M1, a video model with synchronized audio. The company says both were trained on Huawei Ascend hardware, with open weights coming soon.
Tencent releases Hy4 flash: 220B MoE, 12B active parameters, 1M-token context
Tencent has released Hy4 flash, a multimodal Mixture-of-Experts model with 220B total parameters, 12B active per token, and a 1,048,576-token context window. Tencent calls it its most cost-effective Hy model to date and claims a per-task cost of 1/20 that of Hy4 on its internal WorkIndex benchmark.
Tencent releases Hy4 Flash Base: 220B-parameter MoE, 12B active, 1M-token context
Tencent has published Hy4 Flash Base on Hugging Face: a 220B-parameter mixture-of-experts model with 12B active parameters per token, text and image input, and a 1M-token context. Tencent calls it its most cost-effective Hy model to date.
Comments
Loading...