vllm Automatic Prefix Caching

Creator

Creator

Seonglae Cho

Created

Created

2026 Sep 14 17:35

Editor

Editor

Seonglae Cho

Edited

Edited

2026 Sep 14 17:36

Refs

Refs

Automatic Prefix Caching - vLLM

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

https://docs.vllm.ai/en/latest/features/automatic_prefix_caching/

Backlinks

Merkle tree KV cache

Recommendations

///////