ByteDance's Seedance 2.0 Pro tops HKU video AI ranking with 3.84 out of 5 for visual quality
A University of Hong Kong study ranked 12 leading AI video-generation models and found Chinese models ahead of US rivals on visual quality. ByteDance's Seedance 2.0 Pro scored 3.84 out of 5, while several Chinese models fall behind on safety safeguards, according to the researchers.
Chinese AI video-generation models have surpassed leading US rivals in visual quality, but several fall behind on safety safeguards, according to researchers at the University of Hong Kong (HKU). The findings were reported by the South China Morning Post.
Ranking results
ByteDance's Seedance 2.0 Pro took first place in a ranking of 12 leading AI video-generation models, scoring 3.84 out of 5 for visual quality.
The two US models named in the report scored lower:
| Model | Company | Visual quality score (out of 5) |
|---|---|---|
| Seedance 2.0 Pro | ByteDance | 3.84 |
| Veo 3.1 | Google DeepMind | 3.47 |
| Sora 2 Pro | OpenAI | 3.27 |
The study was led by Zhenhui Jack Jiang of HKU.
Safeguards
The researchers found that several of the Chinese models fall behind their US counterparts on safety safeguards. Scores for the safeguard assessment, and the names of the models that trail, are not given in the summary available at publication time.
What this means
The study separates two measures that buyers of video-generation tools often weigh together: output quality and safeguards. On the visual quality measure, the HKU ranking places a ByteDance model ahead of Google DeepMind's Veo 3.1 and OpenAI's Sora 2 Pro. On safeguards, the researchers report that several Chinese models lag. Teams comparing video models should treat the two results as separate criteria rather than a single leaderboard position.
Related Articles
Swapping coding-agent harnesses moves SWE-bench scores about as much as a rerun, but costs can triple, study finds
Two Shandong University researchers held the model constant and swapped coding-agent harnesses. Pass rates on SWE-bench Verified changed about as much as a plain rerun, while per-task cost varied by up to three times. The paper is titled "What does a harness buy? Mostly tokens."
Guide benchmarks Cactus Whistle, a 16.9 MB speech model, against Whisper base on a CPU
MarkTechPost published a coding guide that benchmarks Cactus Compute's 16.9 MB speech model, Cactus Whistle, against Whisper base on a CPU. The guide covers word error rate, speed, streaming latency, timestamps, keywords and speech-to-tool calls.
Microsoft's MAI-DxO scores 83% vs 36% for physicians on complex NEJM cases in Science study
Microsoft's MAI-DxO, a multi-agent diagnostic orchestrator, was correct on 83% of complex New England Journal of Medicine cases in simulation, versus 36% for generalist physicians, according to a study in Science. The data suggests most of the gain comes from stronger base models, with orchestration adding a smaller lift, mainly on complex cases.
Ai2 releases FairStress: 13M-case benchmark finds LLM fairness gaps hidden by final answers
Ai2 has released FairStress, a benchmark of 300 decision scenarios across 29 domains that expands to more than 13 million test cases. It measures whether LLMs change well-supported decisions more readily for one demographic group than another when challenged. Ai2 reports the gap appears as identity becomes more explicit.
Comments
Loading...