Self-hosted runner (benchmark)

New dynamic cache for sliding window attention #2217

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Benchmark (aws-g5-4xlarge-cache)	4m 10s
Benchmark (aws-p4d-24xlarge-plus)	2m 23s
	6m 33s