structured extraction

Cactus Compute has released Needle 3, a foundation model compressed to 8-29 MB that runs entirely on-device for tool calling, structured data extraction, and text embedding. The company claims it beats models 10x its size on mobile tool calls while running on hardware as small as microcontrollers.

Inference.net has released Schematron V2 Turbo, a 3-billion-parameter model built specifically for high-volume HTML-to-JSON extraction. The model supports a 128K context window and is priced at $0.03 per 1M input tokens and $0.15 per 1M output tokens.