IBM Releases Granite Embedding 311M R2 With 32K Context, 200+ Language Support

IBM released Granite Embedding 311M Multilingual R2, a 311-million parameter dense embedding model that produces 768-dimensional vectors with a context length of 32,768 tokens. The model supports 200+ languages based on its multilingual pretraining corpus, with enhanced support for 52 languages and 9 programming languages that receive explicit retrieval-pair and cross-lingual training.

Performance Numbers

Granite Embedding 311M R2 scores 64.0 on Multilingual MTEB Retrieval across 18 tasks—an 11.8-point improvement over the previous granite-embedding-278m-multilingual model (52.2). Across all retrieval benchmarks, the model averages 56.0, representing a 14.2-point gain over the prior generation.

The model is built on the ModernBERT architecture, replacing the XLM-RoBERTa base used in R1. This architectural shift brings alternating attention mechanisms, GeGLU activations, and rotary position embeddings.

Technical Specifications

Context window: 32,768 tokens (up from 512 in R1)
Parameters: 311 million
Embedding dimensions: 768 (full), with Matryoshka support for 512, 384, 256, or 128 dimensions
Vocabulary size: 262,000 tokens covering 200+ languages and code
Architecture: ModernBERT bi-encoder
License: Apache 2.0
Release date: April 29, 2026

The 52 languages with enhanced retrieval support include major European, Asian, and Middle Eastern languages (Albanian, Arabic, Bengali, Chinese, English, French, German, Hindi, Japanese, Korean, Russian, Spanish, and others). Code retrieval is supported for Python, Go, Java, JavaScript, PHP, Ruby, SQL, C, and C++.

Training and Deployment

IBM developed the model using knowledge distillation from multiple teacher models, contrastive fine-tuning, and model merging. According to IBM, all training data uses permissive, enterprise-friendly licenses, including IBM-collected and IBM-generated datasets.

The model ships with ONNX and OpenVINO export formats and is compatible with vLLM and llama.cpp (GGUF). IBM also released a smaller 97-million parameter variant (granite-embedding-97m-multilingual-r2) with 384-dimensional embeddings for latency-sensitive deployments.

The extended 32K context window enables long-document and multi-passage retrieval tasks. Matryoshka dimension reduction allows developers to truncate embeddings from 768 to 128 dimensions with gradual performance degradation, reducing storage and memory requirements.

Model Family

The Granite Embedding R2 release includes four models:

• granite-embedding-311m-multilingual-r2 (768-dim, 200+ languages)
• granite-embedding-97m-multilingual-r2 (384-dim, 200+ languages)
• granite-embedding-english-r2 (English-optimized)
• granite-embedding-small-english-r2 (English-optimized, smaller)

IBM plans to publish a research paper in May 2026. The model is available on Hugging Face and works with the SentenceTransformer library and Hugging Face Transformers.

What This Means

The 32K context window positions Granite Embedding 311M R2 for long-document retrieval tasks that previously required chunking strategies. The 11.8-point MTEB improvement suggests meaningful gains in multilingual retrieval quality, though independent verification of benchmark scores is pending. IBM's focus on permissive licensing and enterprise-grade deployment formats (ONNX, OpenVINO) targets production use cases where model provenance matters. The Matryoshka support provides a practical tradeoff between embedding quality and infrastructure cost.