model release

Cloudflare releases Clef, a 27B Apache-2.0 model that outputs decision probabilities instead of text

TL;DR

Cloudflare published Clef on Hugging Face: a 27B multimodal model that takes a state and a schema of typed questions and returns a probability for every allowed option in a single forward pass. It is post-trained from Qwen3.8-27B and released under Apache-2.0. Benchmark results are from Cloudflare's internal Decision Index 0.2.1 run.

3 min read
0

Cloudflare has released Clef, a 27B-parameter multimodal model that converts a state and a schema of typed questions into probabilities for each allowed answer option. It does this in a single forward pass, with no free-form text generation and no output parsing. The weights are on Hugging Face under the Apache-2.0 license.

Architecture and interface

According to the model card, Clef is post-trained from Qwen/Qwen3.8-27B and keeps that model's vision encoder. The backbone is stored as standard sharded safetensors. A small transformer "joint schema head" reads the backbone's final hidden states, routes evidence from the state to each question, and scores all options of all questions jointly. The output is one logit per allowed option, and a softmax per question yields probabilities.

Input state can be a string, JSON, images, or video frames. Three question types are supported:

  • noul: true/false, returning the probability of true
  • choice: named options, returning the choice, confidence, and probabilities
  • score: ordered options, returning an expected score, confidence, legend, and probabilities

The encode_record function defaults to max_length of 16,384 tokens. Cloudflare does not state a model context window. The card says the Clef API is fully compatible with Jev and SystemOne, and a systemone function mirrors the POST /v1/systemone request and response format. A smaller, faster variant, Clef-Flash, is also available. Its parameter count is not given in the source.

Cloudflare tested the code with torch 2.11 and transformers 5.10.2 on a single H200. Pricing is not yet disclosed, since the weights are self-hostable.

Benchmarks

All figures come from Cloudflare's own run of its Decision Index 0.2.1 suite and have not been independently verified. Comparison columns are Clef-Flash, Jev, DiffusionGemma Jev, Kev 9B, and Laya.

Benchmark Clef Jev
BFCL (case exact accuracy) 98.5 95.8
BANKING77 (macro-F1) 94.2 79.7
CLINC150+OOS (macro-F1) 97.4 89.3
MMLU 90.3 91.7
MMLU-Pro 65.9 82.7
GPQA Diamond 48.0 78.3
BBH 73.7 92.9
GSM8K 80.8 79.9
ForecastBench (Brier, lower is better) 13.9 17.4
Median latency (ms) 209.3 524.1

Clef trails Jev on general-knowledge and reasoning tests, including GPQA Diamond, MMLU-Pro, and BBH. Clef-Flash posts a median latency of 38.8 ms, and its ForecastBench Brier score of 10.6 is better than Clef's. Clef-Flash also beats Clef on several tasks, including the home appliance simulator (97.7 vs 83.0) and CLadder (97.7 vs 94.0). Clef is clearly ahead of Clef-Flash on CLINC150+OOS (97.4 vs 66.8) and RAGTruth hallucination F1 (79.4 vs 35.6).

Workflow evals

On four business workflows from Typesafe Evals, scored against consensus reference labels, Clef edges Jev on three:

  • Invoice processing: 64.7 exact actions and 86.2 primary action, vs 61.8 and 83.1 for Jev
  • Customer service: 76.3 exact actions, vs 76.0 for Jev and 77.0 for Clef-Flash
  • Security incidents: 62.9 exact actions, vs 61.7 for Jev
  • Agent trace observability: 68.5 primary action, behind Jev's 71.6 and Clef-Flash's 69.8

What this means

Clef targets classification, routing, triage, and tool-selection tasks where a downstream system needs calibrated probabilities rather than text that must be parsed. Returning scores for every option in one pass removes parsing failures and makes latency predictable. Cloudflare's reported 209 ms median is less than half of Jev's 524 ms.

The benchmark table shows the trade-off. Clef is strong on structured decision benchmarks but weak on broad reasoning relative to Jev. It is a specialized decision component, not a general assistant. The Apache-2.0 license and Jev/SystemOne API compatibility make it easy to try as a drop-in. But every number here is Cloudflare's own, on its own suite, so teams should validate on their own schemas before relying on it. Hardware for the latency figures is unspecified.

Related Articles

model release

Meituan releases LongCat-2.5: 1.6T-parameter multimodal MoE with 48B active per token

Meituan's LongCat team has published LongCat-2.5, a native multimodal mixture-of-experts model with 1.6 trillion total parameters and approximately 48 billion activated per token. It targets long-horizon agentic tasks such as codebase development and full-project builds, and ships with W4A4 expert quantization for domestic AI accelerators.

model release

inclusionAI releases Duo 1.0 causal-base, a full-duplex multimodal world model initialized from MiniMax H3

inclusionAI has published the Duo 1.0 causal-base weights on Hugging Face. Duo is described as a full-duplex multimodal world model for real-time audio-visual interaction, initialized from MiniMax H3 and trained further by the Duo team.

model release

Qwen4 Max launches with 1M-token context and $1.50/$4.50 per 1M token pricing

Qwen4 Max, the flagship model in Alibaba's Qwen4 series, is listed on OpenRouter with a 1M-token context window. It accepts text, image and video input, returns text, and is priced at $1.50 per 1M input tokens and $4.50 per 1M output tokens.

model release

Runway releases Praxis-1 robot model with open weights under Apache 2.0, tops World Action Models on RoboLab-120

Runway has released Praxis-1, a robot control model, with open weights and source code under the Apache 2.0 license. It scores 46.2 percent on Nvidia's RoboLab-120 leaderboard, ahead of FLUX 3 Action at 42.9 percent, in tests Runway ran itself.

Comments

Loading...