analysisTencent

Tencent AI chief warns models will soon pose biology risks, days after Hy4 launch

TL;DR

Tencent chief AI scientist Yao Shunyu said AI models' cyber abilities, and soon their biology abilities, will reach a threshold where harm is possible, according to the South China Morning Post. He spoke days after Tencent launched its flagship Hy4 model on 4 November.

2 min read
1

Tencent's chief AI scientist has warned that AI models will soon be able to cause harm in biology, as they already can in cybersecurity. Yao Shunyu made the remarks on Saturday at a science event in Hong Kong, the South China Morning Post (SCMP) reported.

"The cyber abilities of [AI] models and soon [the] bio ability of models will reach a threshold where it's actually possible to do harm," Yao said, according to the SCMP.

Open models and safety

Yao said Chinese companies that release open models, which anyone can download and change, need to take safety very seriously. He also warned that biology risks may be harder to manage than cyber risks.

He said US firms such as Anthropic make a strong case for keeping top models closed. However, he argued that a mix of open and closed models may work best, because open models can also help defenders.

Yao is 29. He joined Tencent last year after a year at OpenAI.

Context: the Hy4 launch

Yao spoke days after Tencent launched Hy4, its new flagship model, on 4 November. In its launch announcement, Tencent said it left material on exploiting software flaws out of Hy4's training data. The model was instead trained on defensive security data, the company said.

Tencent also said Hy4 has strong basic knowledge of biology but is weaker than leading models at designing experiments. The company said it based this on internal expert reviews. These are Tencent's claims, and TNW has not tested the model.

According to Reuters, Tencent plans to release Hy4's weights and a report on its safety testing in the coming days. The SCMP reported that benchmarking firm Artificial Analysis ranks Hy4 as the second-best Chinese model.

What this means

The warning comes from the scientist at the company that just released a flagship model, and it frames biology as the next risk area after cybersecurity. Yao's point that biology risks may be harder to manage than cyber risks is his own assessment, as is his view that open and closed models can coexist because open models help defenders.

Tencent's own statements on Hy4 line up with that framing: it says it excluded exploit material from training and rates the model as weaker than leading models at experiment design. Both claims rest on the company's internal expert reviews. The planned release of Hy4's weights and a safety testing report will be the first chance for outside parties to check them. Until then, the biology and security claims remain unverified by independent testing.

Related Articles

Comments

Loading...