Skip to content

Add support for FP8 KV cache scales #1586

Add support for FP8 KV cache scales

Add support for FP8 KV cache scales #1586

Annotations

1 error and 1 warning

build (rocm)  /  integration_tests

failed Oct 21, 2024 in 1m 4s