Ai2 open-sources AstaBrief 8B, a Qwen3-8B report model it says runs 3.5x faster than Claude in Asta
Ai2 has open-sourced AstaBrief 8B, a model fine-tuned from Qwen3-8B that turns a research question and retrieved literature excerpts into a cited report. It is live in Asta as Fast mode, which averages 51.1 seconds per report versus 178.5 seconds for the Claude-powered Thinking mode, according to Ai2. The weights and training data are public.
Ai2 has released AstaBrief 8B, an open-weights model that generates cited scientific reports from a research question and retrieved literature excerpts. The model is available now in Asta's "Generate a report" feature as Fast mode. Ai2 says Fast mode averages 51.1 seconds per report, against 178.5 seconds for the Claude-powered Thinking mode, about 3.5x faster across the full Asta pipeline. The model weights and training data are published on Hugging Face.
Key specifications
- Parameters: 8 billion
- Base model: Qwen3-8B
- Training method: supervised fine-tuning (SFT) followed by direct preference optimization (DPO). Ai2 did not use reinforcement learning, citing instability and cost.
- Input: a user query plus retrieved literature snippets
- Output: a full cited report, written in one pass
- Context window: not disclosed in the source material
- Pricing: the weights are free to download; hosted pricing in Asta has not been disclosed
- License and training cutoff: not specified in the source material
How it was built
Ai2 started with real user queries from the ScholarQA system, the framework behind Asta's report feature. It filtered the logs to remove beta-tester and bot traffic, queries too short to be meaningful, non-English and non-scientific requests, and prompts containing personal information. That left 90,000 research-focused queries.
For SFT, Ai2 generated target reports with the multi-step ScholarQA pipeline, using a mix of proprietary backing models: Claude 3.5 Sonnet, Claude 3.7 Sonnet, o3, o4-mini, and GPT-4.1. After quality filtering, 47,000 training examples remained. DPO used separate preference pairs, with one report preferred over the other for the same query. The source text is truncated before describing how those pairs were built.
Architecture change for speed
AstaBrief skips the snippet summarization and clustering stages used by the Claude-based Thinking mode. It also writes the report in one pass rather than section by section. Ai2 claims this did not reduce quality, and says the 8B model matched the report quality of the proprietary models it tracked. The excerpt provides no numerical quality scores, so that claim cannot yet be checked.
Caveats
Ai2 states that most training and evaluation was completed in 2025. The proprietary teacher and comparison models therefore reflect the frontier at that time, and Ai2 has not rerun the full evaluation against current frontier models. Ai2 says the results are best read as evidence about its training and system-design choices. The 3.5x figure compares Fast mode with Ai2's own Claude-based pipeline, not with a standardized external benchmark.
Ai2 is also releasing an example workflow for generating reports from a user's own PDFs. Open weights let institutions run the model on their own infrastructure, which Ai2 says matters when queries involve sensitive or unpublished work.
What this means
AstaBrief is a narrow, practical case for small specialized models: an 8B SFT+DPO model replaces a multi-stage pipeline built on frontier APIs, and the cost is mainly a data-curation effort. The most reusable parts are probably the real-query filtering and the single-pass report design, not the model itself. The speed gain comes partly from removing pipeline stages, so the 3.5x figure reflects system design as well as model size.
The evidence is thinner than the headline suggests. Quality parity rests on 2025-era comparisons, and the public numbers cover latency, not grounding or citation accuracy. Teams considering AstaBrief should test citation fidelity on their own corpora before relying on it. Local deployment is the clearest advantage for labs handling unpublished research.
Related Articles
TII's Falcon-Emirati-7B scores 84.83% on Alyah, a new Emirati-dialect Arabic benchmark
The Technology Innovation Institute (TII) released Falcon-Emirati-7B, a 7B-parameter model specialized for Emirati Arabic and built on Falcon-H1-Arabic. TII claims it scores 84.83% on the Alyah benchmark, ahead of every Arabic and multilingual model it compared against.
Reflection AI unveils Beam: 501B-parameter open-weight MoE with 1M-token context
Reflection AI has unveiled Beam, a text-only mixture-of-experts model with 501 billion total parameters, 23 billion active, and a 1 million token context window. The company claims it matches Z.ai's GLM-5.2 on advanced reasoning benchmarks while using 3-4x less inference compute. Weights and the full technical report are due later this month.
Reka AI releases Rho-1, a 19B-parameter omni-model for text, image, video and robot control
Reka AI has released a research preview of Rho-1, a 19-billion-parameter omni-model that processes and generates text, images, video, and robot control actions in a single network. Reka says it uses no tool calls or external models. Context window, pricing, and benchmark scores have not been disclosed.
China Telecom's Xing4.0-29B-A4B: 29B MoE, 4B Active, 256K Context, Trained Fully on Ascend NPUs
China Telecom AI's Xing4.0-29B-A4B (formerly the TeleChat line) is a mixture-of-experts model with 29B total and 4B active parameters and a native 256K context window, extensible to 512K. The company claims it is the first model of this scale trained entirely on Ascend NPUs with MindSpore. Community GGUF quantizations from Venastine-Research are already available.
Comments
Loading...