DeepSeek-V4.1-Flash · prefill after a 128K cache hit

vLLM on GB300 DEP2 Prefill Curve

Non-cached input throughput per GPU against prefill step latency (up and to the left is better). Point labels are new tokens per DP rank. Y axis starts at 40K.