ModernBERT
3 articles tagged with ModernBERT
Liquid AI Releases LFM2.5-Encoder Models Claiming 3.7x Faster CPU Inference Than ModernBERT at Long Context
Liquid AI released two open-weight encoder models, LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, built for classification and routing tasks at long context on CPU hardware. The company claims the smaller model runs 3.7x faster than ModernBERT-base at 8,192 tokens while matching or beating larger encoders on GLUE, SuperGLUE, and multilingual benchmarks.
IBM Releases 97M-Parameter Granite Embedding Model With 60.3 MTEB Score — Highest Retrieval Quality Under 100M Parameter
IBM released two new multilingual embedding models under Apache 2.0: a 97M-parameter compact model scoring 60.3 on MTEB Multilingual Retrieval (highest in its size class) and a 311M full-size model scoring 65.2. Both support 200+ languages with enhanced retrieval for 52 languages, handle 32K-token context (64x increase over predecessors), and include code retrieval across 9 programming languages.
IBM Releases Granite Embedding 311M R2 With 32K Context, 200+ Language Support
IBM released Granite Embedding 311M Multilingual R2, a 311-million parameter dense embedding model with 32,768-token context length and support for 200+ languages. The model scores 64.0 on Multilingual MTEB Retrieval (18 tasks), an 11.8-point improvement over its predecessor, and ships with ONNX and OpenVINO models for production deployment.