Dharma-AI's 2B Field Extractor scores 0.834 on its own benchmark, above Claude Opus 5's 0.816
Dharma-AI released Dharma Field Extractor, a 2-billion-parameter model that turns a document image into typed JSON, either open-ended or matched to a supplied schema. According to Dharma-AI, it scored 0.834 on its 1,638-case benchmark, above every frontier configuration tested, and runs self-hosted on a single L40S.
Dharma-AI has released Dharma Field Extractor, a 2-billion-parameter model that takes a document image and returns structured JSON. According to Dharma-AI, it scored 0.834 on the company's own benchmark, above every frontier configuration it tested, from Claude Opus 5 at 0.816 to GPT-5.6 Luna at 0.741. The announcement was published on Hugging Face on November 4, 2026.
What it does
The model accepts a document image and works in two modes:
- Open: no schema is supplied. The model infers which parts of the page are structured fields (a label followed by a value, a table with a header row) from context and layout, and returns everything it finds as key-value pairs.
- Schema-directed: the user specifies each field with a type (string, number or boolean) under the key names their system already uses. The output follows the schema exactly, with the same keys and no extra fields. A field absent from the document comes back as null rather than an invented value.
Tables are filled row by row, and nested documents return nested JSON. Dharma-AI says one checkpoint handles all document types, with no per-type fine-tuning. Examples include invoices with ordered line items, ID documents, medical requisitions and contracts.
Training
The base is DharmaOCR-LITE v1.1, a new 2-billion-parameter version of the OCR model Dharma-AI released in April, already specialized through supervised fine-tuning and DPO. Dharma-AI trained a LoRA adapter on top of it using 43,384 training examples covering both request modes, in three streams, all annotated at field level:
- English multi-domain documents from the public web
- Real Brazilian documents in Portuguese, sourced internally
- A smaller share of other European and Asian languages
The mix spans receipts, commercial invoices, forms, bank statements, ID documents and synthetic documents.
Benchmark results
The benchmark covers 546 documents across three request scenarios, for 1,638 cases: extraction with no schema, a partial schema naming only real fields, and a schema that also includes deliberately nonexistent fields. The score is field-level F1 (matched by path, including table position), multiplied by Levenshtein similarity on matched values and by the share of outputs that are valid JSON.
Dharma-AI ran the same benchmark on four general-purpose frontier configurations, all with reasoning set to low. Claude Opus 5 used adaptive effort. According to the company:
- The quality gap runs from 1.8 points (Claude Opus 5, the closest) to 9.3 points (GPT-5.6 Luna, the widest).
- Cost runs from roughly 6 times lower (GPT-5.6 Luna) to roughly 147 times lower (GPT-5.6 Sol).
SROIE and FUNSD, two public datasets in the benchmark, were not used in training. On a SROIE receipt, Dharma-AI says the model returned all 18 requested fields correctly, including a multi-line unlabeled address and two blank fields as null. On a FUNSD form with twelve boolean fields, it marked the single checked box true and the other eleven false.
Cost basis
The two sides are priced differently. Frontier costs use measured average input and output tokens per page, reasoning tokens included, against each provider's published list pricing. The Field Extractor is not billed per token: it is self-hosted, and its figure is GPU time on a single L40S at $2.24 per hour. Dharma-AI states this is not a sales price and that self-hosted cost depends on hardware, volume and required latency. Context window and training cutoff are not stated.
What this means
The results are Dharma-AI's own, on its own benchmark, so they show performance on this task design rather than general document understanding. The comparison also sets a self-hosted GPU-hour cost against per-token list pricing, a difference Dharma-AI itself flags. Within those limits, the case is one of task specialization: a 2B adapter-tuned model with schema-locked output and null handling for missing fields targets the step where OCR output still needs custom mapping code before reaching a database. The held-out SROIE and FUNSD examples are the evidence offered that the model generalizes beyond its training data.
Related Articles
Sarvam AI releases Prism, a 105B-based decision model that claims 44 ms responses and a 71.8 average score
Sarvam AI has launched Prism, a System 1 decision model built as a LoRA fine-tune of Sarvam 105B. The company claims 44 ms response times and a 71.8 average score across three benchmarks. Weights are on Hugging Face under Apache 2.0.
NeuroDX's 240M-parameter Sphota scores 52.4% vs Liquid AI's 52.1% across about 11 benchmarks, company claims
Indian startup NeuroDX says its 240-million-parameter language model Sphota averaged 52.4% across about 11 benchmarks, against 52.1% for a comparable Liquid AI model. The company also claims 50x less training data and 4.5x better memory efficiency. The results are preliminary and have not been independently evaluated.
OpenAI's Images 2.6 lets ChatGPT generate animated GIFs with speed and frame editing
ChatGPT can now create animated GIFs from a text prompt or an uploaded photo, with controls for playback speed and individual frames. The feature ships with OpenAI's new Images 2.6 model, which OpenAI says also generates images faster. OpenAI says users now generate over 4 billion images per week across ChatGPT and its API.
Pangram releases Image 1.0, claiming 99.96% accuracy on AI image detection, plus Image Flash 1.0 for video
Pangram has released Pangram Image 1.0, an AI image detector that it says reaches 99.96% accuracy on a 1,200-image internal test, and Pangram Image Flash 1.0, a smaller model for AI video detection that it says scores 98.7% on the DF26 benchmark. Both are available through the API, and the image model is integrated into Pangram's Chrome extension.
Comments
Loading...