IBM Releases Granite Embedding 311M R2 With 32K Context, 200+ Language Support
IBM released Granite Embedding 311M Multilingual R2, a 311-million parameter dense embedding model with 32,768-token context length and support for 200+ languages. The model scores 64.0 on Multilingual MTEB Retrieval (18 tasks), an 11.8-point improvement over its predecessor, and ships with ONNX and OpenVINO models for production deployment.
Granite Embedding 311M Multilingual R2 — Quick Specs
IBM Releases Granite Embedding 311M R2 With 32K Context, 200+ Language Support
IBM released Granite Embedding 311M Multilingual R2, a 311-million parameter dense embedding model that produces 768-dimensional vectors with a context length of 32,768 tokens. The model supports 200+ languages based on its multilingual pretraining corpus, with enhanced support for 52 languages and 9 programming languages that receive explicit retrieval-pair and cross-lingual training.
Performance Numbers
Granite Embedding 311M R2 scores 64.0 on Multilingual MTEB Retrieval across 18 tasks—an 11.8-point improvement over the previous granite-embedding-278m-multilingual model (52.2). Across all retrieval benchmarks, the model averages 56.0, representing a 14.2-point gain over the prior generation.
The model is built on the ModernBERT architecture, replacing the XLM-RoBERTa base used in R1. This architectural shift brings alternating attention mechanisms, GeGLU activations, and rotary position embeddings.
Technical Specifications
Context window: 32,768 tokens (up from 512 in R1)
Parameters: 311 million
Embedding dimensions: 768 (full), with Matryoshka support for 512, 384, 256, or 128 dimensions
Vocabulary size: 262,000 tokens covering 200+ languages and code
Architecture: ModernBERT bi-encoder
License: Apache 2.0
Release date: April 29, 2026
The 52 languages with enhanced retrieval support include major European, Asian, and Middle Eastern languages (Albanian, Arabic, Bengali, Chinese, English, French, German, Hindi, Japanese, Korean, Russian, Spanish, and others). Code retrieval is supported for Python, Go, Java, JavaScript, PHP, Ruby, SQL, C, and C++.
Training and Deployment
IBM developed the model using knowledge distillation from multiple teacher models, contrastive fine-tuning, and model merging. According to IBM, all training data uses permissive, enterprise-friendly licenses, including IBM-collected and IBM-generated datasets.
The model ships with ONNX and OpenVINO export formats and is compatible with vLLM and llama.cpp (GGUF). IBM also released a smaller 97-million parameter variant (granite-embedding-97m-multilingual-r2) with 384-dimensional embeddings for latency-sensitive deployments.
The extended 32K context window enables long-document and multi-passage retrieval tasks. Matryoshka dimension reduction allows developers to truncate embeddings from 768 to 128 dimensions with gradual performance degradation, reducing storage and memory requirements.
Model Family
The Granite Embedding R2 release includes four models:
- granite-embedding-311m-multilingual-r2 (768-dim, 200+ languages)
- granite-embedding-97m-multilingual-r2 (384-dim, 200+ languages)
- granite-embedding-english-r2 (English-optimized)
- granite-embedding-small-english-r2 (English-optimized, smaller)
IBM plans to publish a research paper in May 2026. The model is available on Hugging Face and works with the SentenceTransformer library and Hugging Face Transformers.
What This Means
The 32K context window positions Granite Embedding 311M R2 for long-document retrieval tasks that previously required chunking strategies. The 11.8-point MTEB improvement suggests meaningful gains in multilingual retrieval quality, though independent verification of benchmark scores is pending. IBM's focus on permissive licensing and enterprise-grade deployment formats (ONNX, OpenVINO) targets production use cases where model provenance matters. The Matryoshka support provides a practical tradeoff between embedding quality and infrastructure cost.
Related Articles
Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model
Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.
OpenAI RLHF Co-Inventor Launches Jev, a Non-LLM Model That Outputs Probabilities Instead of Text
TypeSafe AI, founded by RLHF co-inventor Diogo Almeida, has released Jev, a transformer-based model that outputs probabilities rather than text. Developers report it running 5 to 20 times cheaper and faster than LLMs for classification tasks.
Z.ai Releases GLM-5.3-FlashX, a 200 Tokens/Second Variant of Its GLM-5.3-Flash Model
Z.ai has released GLM-5.3-FlashX, a high-speed variant of GLM-5.3-Flash built on a hybrid sparse and linear attention architecture with 320B total parameters (18B active). The model supports a 1M-token context window and claims inference speeds of up to 200 tokens per second.
Moonshot AI's 2.8 Trillion-Parameter Kimi K3 Launches on Amazon Bedrock with 1M-Token Context
Moonshot AI's Kimi K3, described by the company as the first open model to reach 2.8 trillion parameters, is now available on Amazon Bedrock. It features native vision, a 1-million-token context window, and is the first open-weight model on Bedrock to support explicit prompt caching.
Comments
Loading...