[Core] Support offloading KV cache to CPU#10874

Open

ApostaC wants to merge 10 commits intovllm-project:mainfrom KuntaiDu:yihua-cpu-offloading2

+1,048-20

Commits on Dec 3, 2024

Commits on Dec 4, 2024

Commits on Dec 8, 2024

[Fix] add the call to get_physical_block_ids
ApostaC
committed

Commits on Dec 9, 2024

Commits on Dec 10, 2024