benchmarks: add script to run llama2 inference benchmarks #4730
Job | Run time |
---|---|
59m 33s | |
0s | |
10m 57s | |
15m 30s | |
12m 18s | |
17m 50s | |
19m 1s | |
18m 22s | |
27m 33s | |
10m 49s | |
1h 4m 59s | |
12m 5s | |
50m 57s | |
52m 39s | |
30m 25s | |
1h 36m 33s | |
8h 19m 31s |
Job | Run time |
---|---|
59m 33s | |
0s | |
10m 57s | |
15m 30s | |
12m 18s | |
17m 50s | |
19m 1s | |
18m 22s | |
27m 33s | |
10m 49s | |
1h 4m 59s | |
12m 5s | |
50m 57s | |
52m 39s | |
30m 25s | |
1h 36m 33s | |
8h 19m 31s |