Skip to content

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache #4213

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache #4213

Annotations

1 warning

labeler

succeeded Dec 6, 2024 in 6s