StepFun Releases Step-3.7-Flash: 198B-Parameter Sparse MoE Model With 256K Context in GGUF Format

StepFun has released Step-3.7-Flash in GGUF quantization format, a 198B-parameter sparse Mixture-of-Experts vision-language model that activates approximately 11B parameters per token. The model is now available for local deployment on consumer hardware with 128GB of unified memory.

Model Architecture and Capabilities

Step-3.7-Flash combines a 196B-parameter language backbone with a 1.8B-parameter vision encoder for native image understanding. According to StepFun, the sparse architecture enables throughput up to 400 tokens per second while maintaining a 256K token context window.

The model offers three selectable reasoning levels—low, medium, and high—designed to balance speed, cost, and reasoning depth. StepFun positions the model for agentic workloads including tool calling, multi-step reasoning, code generation, and mathematics, with native multilingual support.

Quantization Options and Memory Requirements

StepFun released seven quantization variants ranging from BF16 (394GB) to IQ3_XXS (76GB). The recommended Q4_K_S quantization requires 112GB, enabling full 256K context inference on devices with 128GB unified memory, including Apple Mac Studio (M4 Max), NVIDIA DGX Spark (GB10), and AMD Ryzen AI Max+ 395.

All quantizations below Q8_0 use imatrix calibration. A separate 4GB vision projector (mmproj) file enables multimodal inference when paired with any language quantization.

Benchmark Performance

On Apple Mac Studio (M4 Max, 128GB), the Q4_K_S quantization achieved:

• 420 tokens/second prompt processing at 2K context
• 48.5 tokens/second generation at 2K context
• 110 tokens/second prompt processing at 262K context
• 9.7 tokens/second generation at 262K context

On NVIDIA DGX Spark (GB10, 128GB), the same quantization reached 753 tokens/second prompt processing at 8K context and 26 tokens/second generation at 2K context.

The IQ4_XS quantization (105GB) delivered comparable performance with 7GB less memory usage.

Implementation Details

The model requires a custom branch of llama.cpp maintained by StepFun. Users must build from the step3.7 branch to access compatibility with the model's architecture. StepFun provides command-line inference tools and an OpenAI-compatible server for both text-only and multimodal workloads.

Pricing information has not been disclosed. The model files are available on Hugging Face.

What This Means

Step-3.7-Flash represents a significant accessibility milestone for large-scale vision-language models. By activating only 11B of 198B parameters per token, StepFun has made a model with GPT-4-class parameter count deployable on high-end consumer hardware. The 256K context window—previously limited to cloud-based models—can now run locally at speeds viable for production use cases. However, generation speeds drop substantially at maximum context (under 10 t/s at 262K), suggesting practical use will favor shorter contexts. The model's viability for production depends on benchmark scores against established models, which StepFun has not yet published.