Skip to content

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache #7537

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache #7537

Annotations

1 warning

tests-diffusers

succeeded Dec 6, 2024 in 2m 1s