Distribute Literal->Tensor copies across thread pool #3112

Job	Run time
Build XLA / build	42m 17s
Build XLA / build	42m 17s
Collect GPU test coverage	0s
Collect GPU test coverage	0s
Collect CPU test coverage	0s
Collect CPU test coverage	0s
Build & publish docs	0s
Build & publish docs	0s
GPU tests / test (cpp_tests1)	18m 24s
GPU tests / test (cpp_tests1)	18m 24s
GPU tests / test (cpp_tests2)	31m 52s
GPU tests / test (cpp_tests2)	31m 52s
CPU tests / test (cpp_tests1)	12m 17s
CPU tests / test (cpp_tests1)	12m 17s
GPU tests / test (python_tests, xla_op1)	1h 19m 2s
GPU tests / test (python_tests, xla_op1)	1h 19m 2s
CPU tests / test (cpp_tests2)	13m 23s
CPU tests / test (cpp_tests2)	13m 23s
GPU tests / test (python_tests, xla_op2)	2h 13m 42s
GPU tests / test (python_tests, xla_op2)	2h 13m 42s
CPU tests / test (python_tests, xla_op1)	16m 18s
CPU tests / test (python_tests, xla_op1)	16m 18s
GPU tests / test (python_tests, xla_op3)	11m 50s
GPU tests / test (python_tests, xla_op3)	13m 10s
CPU tests / test (python_tests, xla_op2)	9m 11s
CPU tests / test (python_tests, xla_op2)	9m 11s
GPU tests / test (python, torch_mp_op)	36m 14s
GPU tests / test (python, torch_mp_op)	36m 14s
CPU tests / test (python_tests, xla_op3)	10m 4s
CPU tests / test (python_tests, xla_op3)	11m 32s
CPU tests / test (python, torch_mp_op)	14m 19s
CPU tests / test (python, torch_mp_op)	14m 19s
	14h 20m 34s

Provide feedback