vLLM/Recipes

DeepSeek

deepseek-ai·9 recipesHuggingFace

Multimodal

2
DeepSeek-OCR-2
3B
dense
BF167G
v0.12.0+→
DeepSeek-OCR
3B
dense
BF167G
v0.12.0+→

Text

7
DeepSeek-V4-Pro
1600B / 49B
moe
FP8960G
v0.20.0+→
DeepSeek-V4-Flash
284B / 13B
moe
FP8170G
v0.20.0+→
DeepSeek-V3.2
671B / 37B
moe
FP8805GNVFP4403G
v0.18.0+→
DeepSeek-V3.2-Exp
671B / 37B
moe
FP8805G
v0.12.0+→
DeepSeek-V3.1
671B / 37B
moe
FP8805GNVFP4403G
v0.12.0+→
DeepSeek-R1
671B / 37B
moe
FP8805GFP8805GNVFP4403G
v0.12.0+→
DeepSeek-V3
671B / 37B
moe
FP8805GFP4403G
v0.12.0+→