
Key points
DeepSeek KV cache per token by generation (bytes) | Down from 389,120 in V1 to 890 in V4.1, a 437x efficiency gain
Image source: @Jadzo1_

DeepSeek KV cache per token by generation (bytes) | Down from 389,120 in V1 to 890 in V4.1, a 437x efficiency gain
Image source: @Jadzo1_