PR GPU tests

Add tensor parallelism for attention QKVO #3219

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
gpu-latest / pytest-gpu	12m 15s
gpu-2.1.0-flash2 / pytest-gpu	12m 15s
gpu-2.1.0 / pytest-gpu	12m 15s
gpu-2.0.1 / pytest-gpu	11m 58s
	48m 43s