Figure 6 · Fused low-latency decode

The fused decode path makes decode 1.2–1.6× faster

Time per output token (TPOT) on 8× GB300 with TP8 and a 1K-token input, in ms; lower is better.