[CPU] Change kvcache type if user sets INFERENCE_PRECISION_HINT
#91
Job | Run time |
---|---|
3s | |
4m 36s | |
17m 41s | |
16m 36s | |
34m 28s | |
1h 13m 24s |
INFERENCE_PRECISION_HINT
#91
Job | Run time |
---|---|
3s | |
4m 36s | |
17m 41s | |
16m 36s | |
34m 28s | |
1h 13m 24s |