IBM releases Apache 2.0 Granite 4.1 LLMs in 3B, 8B, and 30B sizes
IBM has released the Granite 4.1 family of language models under Apache 2.0 license. The models come in 3B, 8B, and 30B parameter sizes. Unsloth has released 21 GGUF quantized variants of the 3B model ranging from 1.2GB to 6.34GB.
IBM releases Apache 2.0 Granite 4.1 LLMs in 3B, 8B, and 30B sizes
IBM has released the Granite 4.1 family of language models under Apache 2.0 license. The models are available in three sizes: 3B, 8B, and 30B parameters.
Model availability and quantization
Unsloth released 21 GGUF quantized variants of the 3B model on Hugging Face. The quantized files range from 1.2GB to 6.34GB in size, with the full collection totaling 51.3GB. GGUF encoding allows the models to run on consumer hardware with reduced memory requirements.
Training details
Granite team member Yousaf Shah published a detailed description of the training process in "Granite 4.1 LLMs: How They're Built" on the Hugging Face blog. The post covers the technical architecture and training methodology used for the model family.
Model performance
An informal test of the 3B model's SVG generation capabilities across different quantization levels showed inconsistent results. A benchmark test prompting all 21 quantized variants to "Generate an SVG of a pelican riding a bicycle" revealed no clear correlation between model size and output quality. All variants produced abstract shapes rather than recognizable images, suggesting the model was not specifically trained for visual generation tasks.
What this means
The Apache 2.0 license makes Granite 4.1 commercially deployable without restrictions, positioning it as an alternative to models with more restrictive licenses. However, the availability of 21 quantized variants demonstrates the tradeoff space between model size and deployment flexibility. The lack of visual generation capability indicates these models are focused on text processing rather than multimodal tasks, despite being able to output SVG markup. Organizations evaluating Granite 4.1 should test it on their specific use cases rather than assume capabilities based on parameter count alone.
Related Articles
Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model
Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.
Ex-OpenAI Researcher Launches Jev, an AI Model That Scores Options Instead of Generating Text
Startup TypeSafe AI has released Jev, a model built to score predefined answer options rather than generate text, claiming response times of 70 to 500 milliseconds. Co-founder Diogo Almeida, a former OpenAI researcher and InstructGPT co-author, says the model targets background classification tasks like sorting customer requests.
Anonymous Provider Launches Union Alpha, a Free 262K-Context Multimodal Model on OpenRouter
A third-party provider using the alias 'Stealth' has released Union Alpha on OpenRouter, a multimodal model with a 262K context window, currently free to use during its preview period. The model's developer remains anonymous, and OpenRouter states it is not the model's owner or operator.
TypeSafe Launches Jev, a Non-Generative 'Decision Model' Claiming Up to 200x Faster, 400x Cheaper Than Small LLMs
TypeSafe, founded by ChatGPT co-inventor Diogo Almeida, launched Jev on September 15, 2026 — a model that cannot generate free-form text but claims to classify, route, and score 20-200x faster and 40-400x cheaper than small frontier LLMs. Trained via a new method called RLCD, Jev targets production systems that use LLMs purely as structured judges or routers.
Comments
Loading...