DeepSeek Releases V4-Pro-Base with 1.6 Trillion Parameters
DeepSeek has released DeepSeek-V4-Pro-Base, a 1.6 trillion parameter foundation model now available on Hugging Face. The base model uses BF16 precision for weights and includes support for F8_E4M3, I64, and F32 tensor types.
DeepSeek Releases V4-Pro-Base with 1.6 Trillion Parameters
DeepSeek has released DeepSeek-V4-Pro-Base, a 1.6 trillion parameter foundation model now available on Hugging Face. The base model weights are distributed in BF16 precision format.
Technical Specifications
The model includes 1.6 trillion parameters and supports multiple tensor types: BF16 (Brain Floating Point 16), I64 (64-bit integer), F32 (32-bit floating point), and F8_E4M3 (8-bit floating point). The model files are available in the Safetensors format.
As a base model, DeepSeek-V4-Pro-Base is designed for fine-tuning rather than direct deployment. No inference providers have yet added support for hosting the model.
Availability
The model is part of a 4-item collection on Hugging Face that has received 225 interactions. DeepSeek has not disclosed context window size, benchmark scores, or pricing information at the time of release.
The model card on Hugging Face does not include training cutoff dates, architecture details, or performance metrics. Download statistics for the first month are not yet available.
What This Means
At 1.6 trillion parameters, DeepSeek-V4-Pro-Base represents one of the largest openly available foundation models. The "Pro-Base" designation suggests this is an untuned variant intended for research and custom fine-tuning rather than production use. The absence of immediate inference provider support and limited documentation indicates this is an early-stage release targeting the research community and developers who will build instruction-tuned or task-specific variants. The size places it in direct competition with other frontier models, though performance comparisons cannot be made without published benchmarks.
Related Articles
Deepseek open-sources DeepInfer, the Apache 2.0 inference engine behind its V4.1-Flash model
Deepseek has open-sourced DeepInfer, the internal inference framework that serves its V4.1-Flash model, under the Apache License 2.0. The company says it will also open-source code for future models and has released deepseek-recipe to reproduce its API's token processing in self-hosted setups.
NVIDIA releases Kumo Forecast, an Apache 2.0 time-series model built on a ~340M-parameter MOMENT-1-large encoder
NVIDIA has released Kumo Forecast (formerly NV-Tesseract Forecasting), a multivariate time-series forecasting model under Apache 2.0. It pairs a frozen MOMENT-1-large encoder of roughly 340 million parameters with a trainable forecasting head, optional nearest-neighbor retrieval over historical data (DARR), and a built-in interpretability framework.
MiniMax M3.1 Flash scores 42 on AA Intelligence Index at $0.15/$0.60 per 1M tokens, open weights Oct 23
MiniMax has released M3.1 Flash, a reasoning model that scores 42 on the Artificial Analysis Intelligence Index, up from 29 for M3. It costs $0.15 per 1M input tokens and $0.60 per 1M output tokens, and open weights are planned for October 23.
DeepSeek V4.1 Flash 1017 launches with 552B CED backbone, 1M context, $0.15/$0.60 per 1M tokens
DeepSeek has released V4.1 Flash 1017, an October 17, 2026 snapshot built on its new Causal Encoder-Decoder architecture. It uses a 552B-parameter sparse MoE backbone with a 1M-token context window, native image understanding, and pricing of $0.15 input / $0.60 output per 1M tokens on OpenRouter.
Comments
Loading...