SenseTime open-sources 9B SenseNova-Loop-9B-Preview, a looped model, under Apache 2.0
SenseTime open-sourced SenseNova-Loop-9B-Preview on October 30 under Apache 2.0. The multimodal model stores 32 decoder layers but runs 56 layer executions per forward pass, and SenseTime claims it matches models of around 27 billion parameters.
SenseTime open-sourced SenseNova-Loop-9B-Preview on October 30, a multimodal model built on a looped Transformer design. The company says it can match models of around 27 billion parameters with only 9 billion, according to IT Home, as reported by Pandaily. Weights are on Hugging Face under the Apache 2.0 license, and code is on GitHub.
Architecture
According to the model card, the model has 32 distinct decoder layers. The first four and last four layers run once. Layers 4 through 27, a block of 24, are executed twice in sequence with shared weights. That produces 56 decoder-layer executions per forward pass while storing only 32 sets of layer weights.
The card lists about 9 billion total parameters and about 14.6 billion inference parameters.
The decoder interleaves linear and full attention. Each group of four layers has three linear-attention layers followed by one full-attention layer, and the loop boundaries line up with those groups.
The model takes text and images as input and outputs text. Its training recipes use sequences of up to 262,144 tokens, drawing on text, images, code and tool trajectories.
Manifold-constrained hyper-connections
Inside the looped section, SenseTime adds two-stream manifold-constrained hyper-connections (mHC). They carry two residual streams and use learned mappings, constrained by Sinkhorn normalization, to mix information between the streams. The company says its ablation tests showed mHC raised scores on GPQA Diamond by 4.42 points and on TeamBench by 13.34 points.
Benchmarks
SenseTime says that in its evaluation settings the model beats other models across coding, office and agent tasks. It also says the model outperforms Qwen3.5-27B on WorkBuddy Bench, RaccoonPPT Bench and AutomationBench. The benchmark chart on the model card also covers BIRD-Dev, AIDABench, Terminal Bench 2.1 and T3-Banking.
These are the company's own results. The technical report is listed as still to come.
Inference and roadmap
The model supports MTP for faster inference. Two other acceleration methods, Dspark and Dflash2, are still in training. SenseTime says it will next explore DSA and adaptive iteration counts to improve efficiency and task performance.
Pricing and hosted API availability are not yet disclosed. The release is distributed as open weights.
What this means
The design separates stored parameters from compute. The model card lists about 9 billion total parameters and about 14.6 billion inference parameters, because the middle block reuses the same weights on a second pass. Memory footprint tracks the stored weights, while per-token compute reflects the repeated layers. That is the trade the 27-billion-parameter comparison rests on.
That comparison is SenseTime's claim, based on its own evaluation settings. The listed benchmarks include several newer or less common suites, such as WorkBuddy Bench, RaccoonPPT Bench and AutomationBench. The technical report, which is still to come, is where the evaluation setup would be documented.
The Apache 2.0 license and public weights let others test the looped design and the mHC component directly. The adaptive iteration counts SenseTime plans to explore would address the fixed two-pass loop in this preview.
Related Articles
Xiaomi open-sources Xiaomi-OCR-0, a 0.8B document model scoring 96.83 on OmniDocBench v1.6
Xiaomi has released the weights and inference code for Xiaomi-OCR-0, a 0.8B-parameter model that handles document parsing, key information extraction and OCR visual question answering. Xiaomi reports 96.83 on OmniDocBench v1.6, first among models under 1B parameters and second overall.
NVIDIA and MIT team releases Open-H3-Regenerate-2K, regenerating MiniMax H3 video drafts at up to native 4K
The Efficient-Large-Model team, made up of NVIDIA and MIT researchers, released Open-H3-Regenerate-2K weights on Hugging Face. Built on MiniMax H3, it regenerates low-resolution video drafts at 2560×1440 and up to native 3840×2160. The team reports a 3.9x speedup on a single B200 and a higher UniPercept score than the official H3-Regenerate-2K API.
Pika releases H3 Flex, an open-weight video model that generates synchronized audio in six sampling steps
Pika Labs has published Pika H3 Flex, a post-trained H3 model that generates video with synchronized audio in six sampling steps and accepts up to 12 reference inputs. Open weights run locally at native 480p and 768p, while Pika's hosted API adds 1080p, 2K and 4K output.
Edge0 releases Audio8-TTS-Realistic, a 0.6B open-weight voice cloning TTS model under Apache 2.0
Edge0 released Audio8-TTS-Realistic, a 0.6B open-weight zero-shot voice cloning text-to-speech model under Apache 2.0. It supports 23 languages and adds a final GRPO stage driven by a learned realism critic.
Comments
Loading...