Code

Vectorize KV-Cache by using Vec4#222

Code

Draft

officialcjunior wants to merge 2 commits intohuggingface:masterhuggingface/ratchet:masterfrom officialcjunior:vectorize-kv-cacheofficialcjunior/ratchet:vectorize-kv-cacheCopy head branch name to clipboard

+17-9

Commits

Commits on Jun 21, 2024

• Vectorize KV-Cache by using Vec4

  officialcjunior

  committed
  5bd5740

Commits on Jun 23, 2024

• Use Array::<P>> while registering storage and add more conditions for KernelElement

  officialcjunior

  committed
  18f24fb