DeepSeek Releases V4-Pro-Base with 1.6 Trillion Parameters

DeepSeek has released DeepSeek-V4-Pro-Base, a 1.6 trillion parameter foundation model now available on Hugging Face. The base model weights are distributed in BF16 precision format.

Technical Specifications

The model includes 1.6 trillion parameters and supports multiple tensor types: BF16 (Brain Floating Point 16), I64 (64-bit integer), F32 (32-bit floating point), and F8_E4M3 (8-bit floating point). The model files are available in the Safetensors format.

As a base model, DeepSeek-V4-Pro-Base is designed for fine-tuning rather than direct deployment. No inference providers have yet added support for hosting the model.

Availability

The model is part of a 4-item collection on Hugging Face that has received 225 interactions. DeepSeek has not disclosed context window size, benchmark scores, or pricing information at the time of release.

The model card on Hugging Face does not include training cutoff dates, architecture details, or performance metrics. Download statistics for the first month are not yet available.

What This Means

At 1.6 trillion parameters, DeepSeek-V4-Pro-Base represents one of the largest openly available foundation models. The "Pro-Base" designation suggests this is an untuned variant intended for research and custom fine-tuning rather than production use. The absence of immediate inference provider support and limited documentation indicates this is an early-stage release targeting the research community and developers who will build instruction-tuned or task-specific variants. The size places it in direct competition with other frontier models, though performance comparisons cannot be made without published benchmarks.