Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update cuda_deps.yaml for cuda 12.1 with py38 #5699

Closed
wants to merge 1 commit into from

Update cuda_deps.yaml

7c2dae6
Select commit
Loading
Failed to load commit list.
Closed

Update cuda_deps.yaml for cuda 12.1 with py38 #5699

Update cuda_deps.yaml
7c2dae6
Select commit
Loading
Failed to load commit list.
This check has been archived and is scheduled for deletion. Learn more about checks retention
Google Cloud Build / r2-1-0-3-10-cuda-12-1 (tpu-pytorch-releases) succeeded Oct 13, 2023 in 1h 0m 29s

Summary

Build Information

Trigger r2-1-0-3-10-cuda-12-1
Build 7b96baba-6132-4ce8-9ac5-6fafb2b15c9f
Start 2023-10-13T14:28:37-07:00
Duration 59m38.629s
Status SUCCESS

Steps

Step Status Duration
git_fetch SUCCESS 8.422s
git_checkout SUCCESS 692ms
build_xla_docker_image SUCCESS 54m31.784s
push_xla_docker_image SUCCESS 4m42.042s
copy_wheels_to_volume SUCCESS 1.958s
upload_wheels_to_storage_bucket SUCCESS 9.543s

Details

starting build "7b96baba-6132-4ce8-9ac5-6fafb2b15c9f"

FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint: 
hint: 	git config --global init.defaultBranch <name>
hint: 
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint: 
hint: 	git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/pytorch/xla
 * branch            7c2dae651c33a42f31ee783c6797a72effedb675 -> FETCH_HEAD
HEAD is now at 7c2dae6 Update cuda_deps.yaml
BUILD
Starting Step #0 - "git_fetch"
Step #0 - "git_fetch": Already have image (with digest): gcr.io/cloud-builders/git
Step #0 - "git_fetch": From https://github.com/pytorch/xla
Step #0 - "git_fetch":  * [new branch]          2-0-python-3-10         -> origin/2-0-python-3-10
Step #0 - "git_fetch":  * [new branch]          4483-improve-resnet50-data-loading-performance -> origin/4483-improve-resnet50-data-loading-performance
Step #0 - "git_fetch":  * [new branch]          5d-unit-test            -> origin/5d-unit-test
Step #0 - "git_fetch":  * [new branch]          FixTransferToServer     -> origin/FixTransferToServer
Step #0 - "git_fetch":  * [new branch]          JackCaaoG/spmd_device_python_test -> origin/JackCaaoG/spmd_device_python_test
Step #0 - "git_fetch":  * [new branch]          JackCao/Disable_hlo_dump_test_on_tpu -> origin/JackCao/Disable_hlo_dump_test_on_tpu
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_1 -> origin/JackCao/cherry_pick_dynamo_1
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_2 -> origin/JackCao/cherry_pick_dynamo_2
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_3 -> origin/JackCao/cherry_pick_dynamo_3
Step #0 - "git_fetch":  * [new branch]          JackCao/spmd_python_device -> origin/JackCao/spmd_python_device
Step #0 - "git_fetch":  * [new branch]          JackCao/unordered_sharding_spec -> origin/JackCao/unordered_sharding_spec
Step #0 - "git_fetch":  * [new branch]          JackCao/update_to_2.0   -> origin/JackCao/update_to_2.0
Step #0 - "git_fetch":  * [new branch]          JackCao/workaround_einsum_faketensor -> origin/JackCao/workaround_einsum_faketensor
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-1        -> origin/JackCaoG-patch-1
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-2        -> origin/JackCaoG-patch-2
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-3        -> origin/JackCaoG-patch-3
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-4        -> origin/JackCaoG-patch-4
Step #0 - "git_fetch":  * [new branch]          JackCaoG-remove-pin     -> origin/JackCaoG-remove-pin
Step #0 - "git_fetch":  * [new branch]          JackCaoG/1_13_revert_addcmul -> origin/JackCaoG/1_13_revert_addcmul
Step #0 - "git_fetch":  * [new branch]          JackCaoG/2.0_patch      -> origin/JackCaoG/2.0_patch
Step #0 - "git_fetch":  * [new branch]          JackCaoG/AddDynamoSpmdMetrics -> origin/JackCaoG/AddDynamoSpmdMetrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/CI_build_cpp_test -> origin/JackCaoG/CI_build_cpp_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Dyanmo_execute_async -> origin/JackCaoG/Dyanmo_execute_async
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Dynamo_training_test -> origin/JackCaoG/Dynamo_training_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/PJRT_wait_buffer_sync -> origin/JackCaoG/PJRT_wait_buffer_sync
Step #0 - "git_fetch":  * [new branch]          JackCaoG/SPMD_execute_metrics -> origin/JackCaoG/SPMD_execute_metrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/SPMD_int_to_cpu -> origin/JackCaoG/SPMD_int_to_cpu
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Update_short_metrics -> origin/JackCaoG/Update_short_metrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Update_wheel_docker_to_table -> origin/JackCaoG/Update_wheel_docker_to_table
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_dynamo_test_counter_check -> origin/JackCaoG/add_dynamo_test_counter_check
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_dynamo_test_to_tpu_ci -> origin/JackCaoG/add_dynamo_test_to_tpu_ci
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_gpu_doc    -> origin/JackCaoG/add_gpu_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_gpu_doc_readme -> origin/JackCaoG/add_gpu_doc_readme
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_test_dynamo_graph_dump -> origin/JackCaoG/add_test_dynamo_graph_dump
Step #0 - "git_fetch":  * [new branch]          JackCaoG/api_init_runtime -> origin/JackCaoG/api_init_runtime
Step #0 - "git_fetch":  * [new branch]          JackCaoG/barrier_comment -> origin/JackCaoG/barrier_comment
Step #0 - "git_fetch":  * [new branch]          JackCaoG/better_dynamo_error_message -> origin/JackCaoG/better_dynamo_error_message
Step #0 - "git_fetch":  * [new branch]          JackCaoG/build_audio_whl -> origin/JackCaoG/build_audio_whl
Step #0 - "git_fetch":  * [new branch]          JackCaoG/bump+gpu_coverage_timeout -> origin/JackCaoG/bump+gpu_coverage_timeout
Step #0 - "git_fetch":  * [new branch]          JackCaoG/bump_build_timeout -> origin/JackCaoG/bump_build_timeout
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cache_sharded_placeholder_dynamo -> origin/JackCaoG/cache_sharded_placeholder_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cherry_pick_dynamo_test -> origin/JackCaoG/cherry_pick_dynamo_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cherry_picl_xrt_crash_2.1 -> origin/JackCaoG/cherry_picl_xrt_crash_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/clean_up_use_virtual_device -> origin/JackCaoG/clean_up_use_virtual_device
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cleanup_docs   -> origin/JackCaoG/cleanup_docs
Step #0 - "git_fetch":  * [new branch]          JackCaoG/colab_whl_abi  -> origin/JackCaoG/colab_whl_abi
Step #0 - "git_fetch":  * [new branch]          JackCaoG/colab_whl_abi_2 -> origin/JackCaoG/colab_whl_abi_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/data_to_string -> origin/JackCaoG/data_to_string
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_coverage -> origin/JackCaoG/disable_coverage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_dynamo_different_shape_test -> origin/JackCaoG/disable_dynamo_different_shape_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_flaky_test -> origin/JackCaoG/disable_flaky_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_more_dynamic -> origin/JackCaoG/disable_more_dynamic
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_more_dynamic_test -> origin/JackCaoG/disable_more_dynamic_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_test_xla_sharding -> origin/JackCaoG/disable_test_xla_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disbale_docker_sandbox -> origin/JackCaoG/disbale_docker_sandbox
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dump_output_sharding -> origin/JackCaoG/dump_output_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_2.0_cherry_pick -> origin/JackCaoG/dynamo_2.0_cherry_pick
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_debug_message -> origin/JackCaoG/dynamo_debug_message
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_different_graph -> origin/JackCaoG/dynamo_different_graph
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_doc     -> origin/JackCaoG/dynamo_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_dump_tensor_file -> origin/JackCaoG/dynamo_dump_tensor_file
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_note_backport_2.1 -> origin/JackCaoG/dynamo_note_backport_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_only_warm_up_cache -> origin/JackCaoG/dynamo_only_warm_up_cache
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_optimizer -> origin/JackCaoG/dynamo_optimizer
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_reduce_execute -> origin/JackCaoG/dynamo_reduce_execute
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_rng_seed_without_mark_step -> origin/JackCaoG/dynamo_rng_seed_without_mark_step
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd    -> origin/JackCaoG/dynamo_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd_input_sharding_change -> origin/JackCaoG/dynamo_spmd_input_sharding_change
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd_optimization -> origin/JackCaoG/dynamo_spmd_optimization
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_warning -> origin/JackCaoG/dynamo_warning
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_dynamo_upstream_test -> origin/JackCaoG/enable_dynamo_upstream_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_fsdp_gpu_test -> origin/JackCaoG/enable_fsdp_gpu_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_cc_linter_once -> origin/JackCaoG/fix_cc_linter_once
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_deprecated_test_oepration_api -> origin/JackCaoG/fix_deprecated_test_oepration_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dyanmo_additional_tracing -> origin/JackCaoG/fix_dyanmo_additional_tracing
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo     -> origin/JackCaoG/fix_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_crash -> origin/JackCaoG/fix_dynamo_crash
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_inplace -> origin/JackCaoG/fix_dynamo_inplace
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_text_allclose -> origin/JackCaoG/fix_dynamo_text_allclose
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_hlo_dump   -> origin/JackCaoG/fix_hlo_dump
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_hlo_dump_spmd -> origin/JackCaoG/fix_hlo_dump_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_mark_step_on_spmd_device -> origin/JackCaoG/fix_mark_step_on_spmd_device
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_mp_save_test -> origin/JackCaoG/fix_mp_save_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_send_cpu_data -> origin/JackCaoG/fix_send_cpu_data
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_spmd_buff_is_null -> origin/JackCaoG/fix_spmd_buff_is_null
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_tpu_ci_accuracy -> origin/JackCaoG/fix_tpu_ci_accuracy
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_vision_build -> origin/JackCaoG/fix_vision_build
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fsdp_autowrap_test -> origin/JackCaoG/fsdp_autowrap_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/gpu_build_pytorch_cuda -> origin/JackCaoG/gpu_build_pytorch_cuda
Step #0 - "git_fetch":  * [new branch]          JackCaoG/handle_dynamo_fn_without_arg -> origin/JackCaoG/handle_dynamo_fn_without_arg
Step #0 - "git_fetch":  * [new branch]          JackCaoG/improve_data_tostring -> origin/JackCaoG/improve_data_tostring
Step #0 - "git_fetch":  * [new branch]          JackCaoG/increase_timeout_docker -> origin/JackCaoG/increase_timeout_docker
Step #0 - "git_fetch":  * [new branch]          JackCaoG/ir_value_sharding -> origin/JackCaoG/ir_value_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/lower_dropout_backward -> origin/JackCaoG/lower_dropout_backward
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_op_lowering_guide -> origin/JackCaoG/move_op_lowering_guide
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_pin_2_0   -> origin/JackCaoG/move_pin_2_0
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_pjrt_lock_location -> origin/JackCaoG/move_pjrt_lock_location
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_return_future -> origin/JackCaoG/move_return_future
Step #0 - "git_fetch":  * [new branch]          JackCaoG/new_alias_api  -> origin/JackCaoG/new_alias_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/parallel_spmd  -> origin/JackCaoG/parallel_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pin_update_20230808 -> origin/JackCaoG/pin_update_20230808
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r20_backportdoc -> origin/JackCaoG/r20_backportdoc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_ABI_0     -> origin/JackCaoG/r2_0_ABI_0
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_back_port_profile_flag -> origin/JackCaoG/r2_0_back_port_profile_flag
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_backport_loader_thread -> origin/JackCaoG/r2_0_backport_loader_thread
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_backport_loader_thread_2 -> origin/JackCaoG/r2_0_backport_loader_thread_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_cherry_pick_defer_init -> origin/JackCaoG/r2_0_cherry_pick_defer_init
Step #0 - "git_fetch":  * [new branch]          JackCaoG/remove_pin     -> origin/JackCaoG/remove_pin
Step #0 - "git_fetch":  * [new branch]          JackCaoG/restrict_mark_sharding -> origin/JackCaoG/restrict_mark_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/revert_addcmul -> origin/JackCaoG/revert_addcmul
Step #0 - "git_fetch":  * [new branch]          JackCaoG/revert_protobuf_tf_patch -> origin/JackCaoG/revert_protobuf_tf_patch
Step #0 - "git_fetch":  * [new branch]          JackCaoG/shard_device_data_ir -> origin/JackCaoG/shard_device_data_ir
Step #0 - "git_fetch":  * [new branch]          JackCaoG/skip_tpu_test_precision -> origin/JackCaoG/skip_tpu_test_precision
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_aliasing  -> origin/JackCaoG/spmd_aliasing
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_dynamo_sharding_changed -> origin/JackCaoG/spmd_dynamo_sharding_changed
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_incorrect_result -> origin/JackCaoG/spmd_incorrect_result
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tensor_debugging_api -> origin/JackCaoG/tensor_debugging_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tensor_with_xla_data_sharding -> origin/JackCaoG/tensor_with_xla_data_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/test_torch_compile_usage -> origin/JackCaoG/test_torch_compile_usage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tf_update_20230201 -> origin/JackCaoG/tf_update_20230201
Step #0 - "git_fetch":  * [new branch]          JackCaoG/unordered_partial_sharding_spec -> origin/JackCaoG/unordered_partial_sharding_spec
Step #0 - "git_fetch":  * [new branch]          JackCaoG/updateDocker   -> origin/JackCaoG/updateDocker
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_2_0_ABI -> origin/JackCaoG/update_2_0_ABI
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_API_GUIDE -> origin/JackCaoG/update_API_GUIDE
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_XLA_IR_SHAPE_CACHE_SIZE -> origin/JackCaoG/update_XLA_IR_SHAPE_CACHE_SIZE
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_build_guide -> origin/JackCaoG/update_build_guide
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_colab_2_10_whl -> origin/JackCaoG/update_colab_2_10_whl
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_doc1    -> origin/JackCaoG/update_doc1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_doc_remove_xrt -> origin/JackCaoG/update_doc_remove_xrt
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_docker_instruction -> origin/JackCaoG/update_docker_instruction
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_backend_name -> origin/JackCaoG/update_dynamo_backend_name
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_backend_nograd -> origin/JackCaoG/update_dynamo_backend_nograd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_doc -> origin/JackCaoG/update_dynamo_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_number_2.1 -> origin/JackCaoG/update_dynamo_number_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_readme -> origin/JackCaoG/update_dynamo_readme
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_save_graph_path -> origin/JackCaoG/update_dynamo_save_graph_path
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_torch_equal -> origin/JackCaoG/update_dynamo_torch_equal
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_doc -> origin/JackCaoG/update_gpu_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_wheel_link -> origin/JackCaoG/update_gpu_wheel_link
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_wheellink -> origin/JackCaoG/update_gpu_wheellink
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_pjrt_future -> origin/JackCaoG/update_pjrt_future
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_readme_2 -> origin/JackCaoG/update_readme_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_tf_2023018 -> origin/JackCaoG/update_tf_2023018
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_to_2.2  -> origin/JackCaoG/update_to_2.2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_torch_compile_usage -> origin/JackCaoG/update_torch_compile_usage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_wheel_docker_format -> origin/JackCaoG/update_wheel_docker_format
Step #0 - "git_fetch":  * [new branch]          JackCaoG/use_new_alias_api -> origin/JackCaoG/use_new_alias_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/xrt_cherry_pick_07_10 -> origin/JackCaoG/xrt_cherry_pick_07_10
Step #0 - "git_fetch":  * [new branch]          JackCaoG/xrt_cherrypick_0721 -> origin/JackCaoG/xrt_cherrypick_0721
Step #0 - "git_fetch":  * [new branch]          JackCaog/dynamo_input_sharding -> origin/JackCaog/dynamo_input_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaog/quick_spmd_fix -> origin/JackCaog/quick_spmd_fix
Step #0 - "git_fetch":  * [new branch]          JackCaog/spmd_device_default -> origin/JackCaog/spmd_device_default
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-1       -> origin/ManfeiBai-patch-1
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-10      -> origin/ManfeiBai-patch-10
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-11      -> origin/ManfeiBai-patch-11
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-12      -> origin/ManfeiBai-patch-12
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-13      -> origin/ManfeiBai-patch-13
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-14      -> origin/ManfeiBai-patch-14
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-15      -> origin/ManfeiBai-patch-15
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-16      -> origin/ManfeiBai-patch-16
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-17      -> origin/ManfeiBai-patch-17
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-18      -> origin/ManfeiBai-patch-18
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-19      -> origin/ManfeiBai-patch-19
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-2       -> origin/ManfeiBai-patch-2
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-20      -> origin/ManfeiBai-patch-20
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-21      -> origin/ManfeiBai-patch-21
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-22      -> origin/ManfeiBai-patch-22
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-23      -> origin/ManfeiBai-patch-23
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-24      -> origin/ManfeiBai-patch-24
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-25      -> origin/ManfeiBai-patch-25
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-26      -> origin/ManfeiBai-patch-26
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-27      -> origin/ManfeiBai-patch-27
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-28      -> origin/ManfeiBai-patch-28
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-29      -> origin/ManfeiBai-patch-29
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-3       -> origin/ManfeiBai-patch-3
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-30      -> origin/ManfeiBai-patch-30
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-31      -> origin/ManfeiBai-patch-31
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-32      -> origin/ManfeiBai-patch-32
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-33      -> origin/ManfeiBai-patch-33
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-34      -> origin/ManfeiBai-patch-34
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-35      -> origin/ManfeiBai-patch-35
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-36      -> origin/ManfeiBai-patch-36
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-37      -> origin/ManfeiBai-patch-37
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-4       -> origin/ManfeiBai-patch-4
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-5       -> origin/ManfeiBai-patch-5
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-6       -> origin/ManfeiBai-patch-6
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-7       -> origin/ManfeiBai-patch-7
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-8       -> origin/ManfeiBai-patch-8
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-9       -> origin/ManfeiBai-patch-9
Step #0 - "git_fetch":  * [new branch]          XLASymNodeImplSub       -> origin/XLASymNodeImplSub
Step #0 - "git_fetch":  * [new branch]          XLA_HLO_DEBUG_METADATA  -> origin/XLA_HLO_DEBUG_METADATA
Step #0 - "git_fetch":  * [new branch]          a_tensor_cleanup        -> origin/a_tensor_cleanup
Step #0 - "git_fetch":  * [new branch]          accu_rate               -> origin/accu_rate
Step #0 - "git_fetch":  * [new branch]          adapt_lazy_fun_1        -> origin/adapt_lazy_fun_1
Step #0 - "git_fetch":  * [new branch]          add-imagenet-learning-rate-optimizer -> origin/add-imagenet-learning-rate-optimizer
Step #0 - "git_fetch":  * [new branch]          add-imagenet-learning-rate-scheduler -> origin/add-imagenet-learning-rate-scheduler
Step #0 - "git_fetch":  * [new branch]          add-imagenet-learning-schedule -> origin/add-imagenet-learning-schedule
Step #0 - "git_fetch":  * [new branch]          add-summary-writer      -> origin/add-summary-writer
Step #0 - "git_fetch":  * [new branch]          addAddDivToXLASymIntNodeImpl -> origin/addAddDivToXLASymIntNodeImpl
Step #0 - "git_fetch":  * [new branch]          addAnotherExpandSymintPyTest -> origin/addAnotherExpandSymintPyTest
Step #0 - "git_fetch":  * [new branch]          addAnsibleToR112        -> origin/addAnsibleToR112
Step #0 - "git_fetch":  * [new branch]          addAnsibleToR113        -> origin/addAnsibleToR113
Step #0 - "git_fetch":  * [new branch]          addDSModelTest          -> origin/addDSModelTest
Step #0 - "git_fetch":  * [new branch]          addExpandSymintTest     -> origin/addExpandSymintTest
Step #0 - "git_fetch":  * [new branch]          addMoreTestsForSizeAdd  -> origin/addMoreTestsForSizeAdd
Step #0 - "git_fetch":  * [new branch]          addPatch                -> origin/addPatch
Step #0 - "git_fetch":  * [new branch]          addPin                  -> origin/addPin
Step #0 - "git_fetch":  * [new branch]          addPy310Cuda118NightlyWheel -> origin/addPy310Cuda118NightlyWheel
Step #0 - "git_fetch":  * [new branch]          addTestForNonzero       -> origin/addTestForNonzero
Step #0 - "git_fetch":  * [new branch]          addVersionSelectionToR111 -> origin/addVersionSelectionToR111
Step #0 - "git_fetch":  * [new branch]          addVersionSelectionToR112 -> origin/addVersionSelectionToR112
Step #0 - "git_fetch":  * [new branch]          addVersionSelectionToR113 -> origin/addVersionSelectionToR113
Step #0 - "git_fetch":  * [new branch]          add_gitignore           -> origin/add_gitignore
Step #0 - "git_fetch":  * [new branch]          add_gitrev              -> origin/add_gitrev
Step #0 - "git_fetch":  * [new branch]          add_ne_size_node        -> origin/add_ne_size_node
Step #0 - "git_fetch":  * [new branch]          add_os_import_cifar     -> origin/add_os_import_cifar
Step #0 - "git_fetch":  * [new branch]          add_py_bench            -> origin/add_py_bench
Step #0 - "git_fetch":  * [new branch]          add_rendezvous_test     -> origin/add_rendezvous_test
Step #0 - "git_fetch":  * [new branch]          add_roots_tags          -> origin/add_roots_tags
Step #0 - "git_fetch":  * [new branch]          add_set_dimension_sizes -> origin/add_set_dimension_sizes
Step #0 - "git_fetch":  * [new branch]          add_symint_to_ci_docker -> origin/add_symint_to_ci_docker
Step #0 - "git_fetch":  * [new branch]          add_symint_util         -> origin/add_symint_util
Step #0 - "git_fetch":  * [new branch]          add_telemetry_env_var   -> origin/add_telemetry_env_var
Step #0 - "git_fetch":  * [new branch]          add_test_filter         -> origin/add_test_filter
Step #0 - "git_fetch":  * [new branch]          add_toxla_test          -> origin/add_toxla_test
Step #0 - "git_fetch":  * [new branch]          add_zach_comment        -> origin/add_zach_comment
Step #0 - "git_fetch":  * [new branch]          addcmul                 -> origin/addcmul
Step #0 - "git_fetch":  * [new branch]          addneg                  -> origin/addneg
Step #0 - "git_fetch":  * [new branch]          addr                    -> origin/addr
Step #0 - "git_fetch":  * [new branch]          aifix_warnings          -> origin/aifix_warnings
Step #0 - "git_fetch":  * [new branch]          ailing_fix_sums         -> origin/ailing_fix_sums
Step #0 - "git_fetch":  * [new branch]          ailzhang-patch-1        -> origin/ailzhang-patch-1
Step #0 - "git_fetch":  * [new branch]          alanwaketan/addcdiv     -> origin/alanwaketan/addcdiv
Step #0 - "git_fetch":  * [new branch]          alanwaketan/alias       -> origin/alanwaketan/alias
Step #0 - "git_fetch":  * [new branch]          alanwaketan/all_gather  -> origin/alanwaketan/all_gather
Step #0 - "git_fetch":  * [new branch]          alanwaketan/all_gather_token -> origin/alanwaketan/all_gather_token
Step #0 - "git_fetch":  * [new branch]          alanwaketan/all_reduce  -> origin/alanwaketan/all_reduce
Step #0 - "git_fetch":  * [new branch]          alanwaketan/all_reduce_d -> origin/alanwaketan/all_reduce_d
Step #0 - "git_fetch":  * [new branch]          alanwaketan/all_reduce_t -> origin/alanwaketan/all_reduce_t
Step #0 - "git_fetch":  * [new branch]          alanwaketan/as_strided  -> origin/alanwaketan/as_strided
Step #0 - "git_fetch":  * [new branch]          alanwaketan/as_strided_2 -> origin/alanwaketan/as_strided_2
Step #0 - "git_fetch":  * [new branch]          alanwaketan/build_input_output -> origin/alanwaketan/build_input_output
Step #0 - "git_fetch":  * [new branch]          alanwaketan/cc          -> origin/alanwaketan/cc
Step #0 - "git_fetch":  * [new branch]          alanwaketan/ci          -> origin/alanwaketan/ci
Step #0 - "git_fetch":  * [new branch]          alanwaketan/conv        -> origin/alanwaketan/conv
Step #0 - "git_fetch":  * [new branch]          alanwaketan/copy        -> origin/alanwaketan/copy
Step #0 - "git_fetch":  * [new branch]          alanwaketan/cpp_test    -> origin/alanwaketan/cpp_test
Step #0 - "git_fetch":  * [new branch]          alanwaketan/custom_sharding -> origin/alanwaketan/custom_sharding
Step #0 - "git_fetch":  * [new branch]          alanwaketan/debug       -> origin/alanwaketan/debug
Step #0 - "git_fetch":  * [new branch]          alanwaketan/detach      -> origin/alanwaketan/detach
Step #0 - "git_fetch":  * [new branch]          alanwaketan/detach_2    -> origin/alanwaketan/detach_2
Step #0 - "git_fetch":  * [new branch]          alanwaketan/diagonal_scatter -> origin/alanwaketan/diagonal_scatter
Step #0 - "git_fetch":  * [new branch]          alanwaketan/dist_2      -> origin/alanwaketan/dist_2
Step #0 - "git_fetch":  * [new branch]          alanwaketan/ds          -> origin/alanwaketan/ds
Step #0 - "git_fetch":  * [new branch]          alanwaketan/dump_hlo    -> origin/alanwaketan/dump_hlo
Step #0 - "git_fetch":  * [new branch]          alanwaketan/dynamic_shape -> origin/alanwaketan/dynamic_shape
Step #0 - "git_fetch":  * [new branch]          alanwaketan/experiments -> origin/alanwaketan/experiments
Step #0 - "git_fetch":  * [new branch]          alanwaketan/exponential -> origin/alanwaketan/exponential
Step #0 - "git_fetch":  * [new branch]          alanwaketan/fix         -> origin/alanwaketan/fix
Step #0 - "git_fetch":  * [new branch]          alanwaketan/flag        -> origin/alanwaketan/flag
Step #0 - "git_fetch":  * [new branch]          alanwaketan/fsdp        -> origin/alanwaketan/fsdp
Step #0 - "git_fetch":  * [new branch]          alanwaketan/fsdp_data   -> origin/alanwaketan/fsdp_data
Step #0 - "git_fetch":  * [new branch]          alanwaketan/fsdp_detach -> origin/alanwaketan/fsdp_detach
Step #0 - "git_fetch":  * [new branch]          alanwaketan/func_test   -> origin/alanwaketan/func_test
Step #0 - "git_fetch":  * [new branch]          alanwaketan/graph_exe   -> origin/alanwaketan/graph_exe
Step #0 - "git_fetch":  * [new branch]          alanwaketan/gru         -> origin/alanwaketan/gru
Step #0 - "git_fetch":  * [new branch]          alanwaketan/hide_token  -> origin/alanwaketan/hide_token
Step #0 - "git_fetch":  * [new branch]          alanwaketan/hlo_spmd    -> origin/alanwaketan/hlo_spmd
Step #0 - "git_fetch":  * [new branch]          alanwaketan/inputoutput -> origin/alanwaketan/inputoutput
Step #0 - "git_fetch":  * [new branch]          alanwaketan/lazy_graph  -> origin/alanwaketan/lazy
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/cloud-build/builds;region=us-central1/7b96baba-6132-4ce8-9ac5-6fafb2b15c9f?project=1001674285173.]
...
es/pip.py
Step #2 - "build_xla_docker_image": <127.0.0.1> PUT /root/.ansible/tmp/ansible-local-7wzdn5ar8/tmpeo4kw52c TO /root/.ansible/tmp/ansible-tmp-1697235607.9196825-2517-185404856004290/AnsiballZ_pip.py
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c 'chmod u+x /root/.ansible/tmp/ansible-tmp-1697235607.9196825-2517-185404856004290/ /root/.ansible/tmp/ansible-tmp-1697235607.9196825-2517-185404856004290/AnsiballZ_pip.py && sleep 0'
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c '/usr/local/bin/python /root/.ansible/tmp/ansible-tmp-1697235607.9196825-2517-185404856004290/AnsiballZ_pip.py && sleep 0'
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c 'rm -f -r /root/.ansible/tmp/ansible-tmp-1697235607.9196825-2517-185404856004290/ > /dev/null 2>&1 && sleep 0'
Step #2 - "build_xla_docker_image": changed: [localhost] => changed=true 
Step #2 - "build_xla_docker_image":   cmd:
Step #2 - "build_xla_docker_image":   - /usr/local/bin/python
Step #2 - "build_xla_docker_image":   - -m
Step #2 - "build_xla_docker_image":   - pip.__main__
Step #2 - "build_xla_docker_image":   - install
Step #2 - "build_xla_docker_image":   - numpy
Step #2 - "build_xla_docker_image":   - pyyaml
Step #2 - "build_xla_docker_image":   - mkl
Step #2 - "build_xla_docker_image":   - mkl-include
Step #2 - "build_xla_docker_image":   invocation:
Step #2 - "build_xla_docker_image":     module_args:
Step #2 - "build_xla_docker_image":       chdir: null
Step #2 - "build_xla_docker_image":       editable: false
Step #2 - "build_xla_docker_image":       executable: null
Step #2 - "build_xla_docker_image":       extra_args: null
Step #2 - "build_xla_docker_image":       name:
Step #2 - "build_xla_docker_image":       - numpy
Step #2 - "build_xla_docker_image":       - pyyaml
Step #2 - "build_xla_docker_image":       - mkl
Step #2 - "build_xla_docker_image":       - mkl-include
Step #2 - "build_xla_docker_image":       requirements: null
Step #2 - "build_xla_docker_image":       state: present
Step #2 - "build_xla_docker_image":       umask: null
Step #2 - "build_xla_docker_image":       version: null
Step #2 - "build_xla_docker_image":       virtualenv: null
Step #2 - "build_xla_docker_image":       virtualenv_command: virtualenv
Step #2 - "build_xla_docker_image":       virtualenv_python: null
Step #2 - "build_xla_docker_image":       virtualenv_site_packages: false
Step #2 - "build_xla_docker_image":   name:
Step #2 - "build_xla_docker_image":   - numpy
Step #2 - "build_xla_docker_image":   - pyyaml
Step #2 - "build_xla_docker_image":   - mkl
Step #2 - "build_xla_docker_image":   - mkl-include
Step #2 - "build_xla_docker_image":   requirements: null
Step #2 - "build_xla_docker_image":   state: present
Step #2 - "build_xla_docker_image":   stderr: |-
Step #2 - "build_xla_docker_image":     WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Step #2 - "build_xla_docker_image":   
Step #2 - "build_xla_docker_image":     [notice] A new release of pip is available: 23.0.1 -> 23.2.1
Step #2 - "build_xla_docker_image":     [notice] To update, run: pip install --upgrade pip
Step #2 - "build_xla_docker_image":   stderr_lines: <omitted>
Step #2 - "build_xla_docker_image":   stdout: |-
Step #2 - "build_xla_docker_image":     Collecting numpy
Step #2 - "build_xla_docker_image":       Downloading numpy-1.26.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 78.5 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0.1)
Step #2 - "build_xla_docker_image":     Collecting mkl
Step #2 - "build_xla_docker_image":       Downloading mkl-2023.2.0-py2.py3-none-manylinux1_x86_64.whl (258.0 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 258.0/258.0 MB 9.8 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Collecting mkl-include
Step #2 - "build_xla_docker_image":       Downloading mkl_include-2023.2.0-py2.py3-none-manylinux1_x86_64.whl (1.2 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 65.9 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Collecting intel-openmp==2023.*
Step #2 - "build_xla_docker_image":       Downloading intel_openmp-2023.2.0-py2.py3-none-manylinux1_x86_64.whl (20.2 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.2/20.2 MB 78.8 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Collecting tbb==2021.*
Step #2 - "build_xla_docker_image":       Downloading tbb-2021.10.0-py2.py3-none-manylinux1_x86_64.whl (4.4 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 89.3 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Installing collected packages: tbb, mkl-include, intel-openmp, numpy, mkl
Step #2 - "build_xla_docker_image":     Successfully installed intel-openmp-2023.2.0 mkl-2023.2.0 mkl-include-2023.2.0 numpy-1.26.0 tbb-2021.10.0
Step #2 - "build_xla_docker_image":   stdout_lines: <omitted>
Step #2 - "build_xla_docker_image":   version: null
Step #2 - "build_xla_docker_image":   virtualenv: null
Step #2 - "build_xla_docker_image": 
Step #2 - "build_xla_docker_image": TASK [install_deps : Install pip packages without deps (--no-deps)] ************
Step #2 - "build_xla_docker_image": task path: /ansible/roles/install_deps/tasks/main.yaml:32
Step #2 - "build_xla_docker_image": Friday 13 October 2023  22:20:23 +0000 (0:00:15.696)       0:03:07.707 ******** 
Step #2 - "build_xla_docker_image": <127.0.0.1> ESTABLISH LOCAL CONNECTION FOR USER: root
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c 'echo ~root && sleep 0'
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /root/.ansible/tmp `"&& mkdir "` echo /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457 `" && echo ansible-tmp-1697235623.6184428-2551-176966976297457="` echo /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457 `" ) && sleep 0'
Step #2 - "build_xla_docker_image": Using module file /usr/local/lib/python3.10/site-packages/ansible/modules/pip.py
Step #2 - "build_xla_docker_image": <127.0.0.1> PUT /root/.ansible/tmp/ansible-local-7wzdn5ar8/tmpx8iqxrdb TO /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457/AnsiballZ_pip.py
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c 'chmod u+x /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457/ /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457/AnsiballZ_pip.py && sleep 0'
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c '/usr/local/bin/python /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457/AnsiballZ_pip.py && sleep 0'
Step #2 - "build_xla_docker_image": <127.0.0.1> EXEC /bin/sh -c 'rm -f -r /root/.ansible/tmp/ansible-tmp-1697235623.6184428-2551-176966976297457/ > /dev/null 2>&1 && sleep 0'
Step #2 - "build_xla_docker_image": changed: [localhost] => changed=true 
Step #2 - "build_xla_docker_image":   cmd:
Step #2 - "build_xla_docker_image":   - /usr/local/bin/python
Step #2 - "build_xla_docker_image":   - -m
Step #2 - "build_xla_docker_image":   - pip.__main__
Step #2 - "build_xla_docker_image":   - install
Step #2 - "build_xla_docker_image":   - --no-deps
Step #2 - "build_xla_docker_image":   - torchvision
Step #2 - "build_xla_docker_image":   - pillow
Step #2 - "build_xla_docker_image":   invocation:
Step #2 - "build_xla_docker_image":     module_args:
Step #2 - "build_xla_docker_image":       chdir: null
Step #2 - "build_xla_docker_image":       editable: false
Step #2 - "build_xla_docker_image":       executable: null
Step #2 - "build_xla_docker_image":       extra_args: --no-deps
Step #2 - "build_xla_docker_image":       name:
Step #2 - "build_xla_docker_image":       - torchvision
Step #2 - "build_xla_docker_image":       - pillow
Step #2 - "build_xla_docker_image":       requirements: null
Step #2 - "build_xla_docker_image":       state: present
Step #2 - "build_xla_docker_image":       umask: null
Step #2 - "build_xla_docker_image":       version: null
Step #2 - "build_xla_docker_image":       virtualenv: null
Step #2 - "build_xla_docker_image":       virtualenv_command: virtualenv
Step #2 - "build_xla_docker_image":       virtualenv_python: null
Step #2 - "build_xla_docker_image":       virtualenv_site_packages: false
Step #2 - "build_xla_docker_image":   name:
Step #2 - "build_xla_docker_image":   - torchvision
Step #2 - "build_xla_docker_image":   - pillow
Step #2 - "build_xla_docker_image":   requirements: null
Step #2 - "build_xla_docker_image":   state: present
Step #2 - "build_xla_docker_image":   stderr: |-
Step #2 - "build_xla_docker_image":     WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Step #2 - "build_xla_docker_image":   
Step #2 - "build_xla_docker_image":     [notice] A new release of pip is available: 23.0.1 -> 23.2.1
Step #2 - "build_xla_docker_image":     [notice] To update, run: pip install --upgrade pip
Step #2 - "build_xla_docker_image":   stderr_lines: <omitted>
Step #2 - "build_xla_docker_image":   stdout: |-
Step #2 - "build_xla_docker_image":     Collecting torchvision
Step #2 - "build_xla_docker_image":       Downloading torchvision-0.16.0-cp310-cp310-manylinux1_x86_64.whl (6.9 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.9/6.9 MB 56.3 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Collecting pillow
Step #2 - "build_xla_docker_image":       Downloading Pillow-10.0.1-cp310-cp310-manylinux_2_28_x86_64.whl (3.6 MB)
Step #2 - "build_xla_docker_image":          ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 90.8 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image":     Installing collected packages: torchvision, pillow
Step #2 - "build_xla_docker_image":     Successfully installed pillow-10.0.1 torchvision-0.16.0
Step #2 - "build_xla_docker_image":   stdout_lines: <omitted>
Step #2 - "build_xla_docker_image":   version: null
Step #2 - "build_xla_docker_image":   virtualenv: null
Step #2 - "build_xla_docker_image": 
Step #2 - "build_xla_docker_image": PLAY RECAP *********************************************************************
Step #2 - "build_xla_docker_image": localhost                  : ok=8    changed=5    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
Step #2 - "build_xla_docker_image": 
Step #2 - "build_xla_docker_image": Friday 13 October 2023  22:20:26 +0000 (0:00:03.155)       0:03:10.862 ******** 
Step #2 - "build_xla_docker_image": =============================================================================== 
Step #2 - "build_xla_docker_image": install_deps : Install apt packages ----------------------------------- 153.41s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:23 --------------------------------
Step #2 - "build_xla_docker_image": install_deps : Install pip packages ------------------------------------ 15.70s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:28 --------------------------------
Step #2 - "build_xla_docker_image": install_deps : Add apt repositories into sources list ------------------ 12.79s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:11 --------------------------------
Step #2 - "build_xla_docker_image": install_deps : Update apt cache ----------------------------------------- 3.41s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:18 --------------------------------
Step #2 - "build_xla_docker_image": install_deps : Install pip packages without deps (--no-deps) ------------ 3.16s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:32 --------------------------------
Step #2 - "build_xla_docker_image": install_deps : Add apt keys --------------------------------------------- 1.21s
Step #2 - "build_xla_docker_image": /ansible/roles/install_deps/tasks/main.yaml:1 ---------------------------------
Step #2 - "build_xla_docker_image": Gathering Facts --------------------------------------------------------- 1.07s
Step #2 - "build_xla_docker_image": /ansible/playbook.yaml:1 ------------------------------------------------------
Step #2 - "build_xla_docker_image": Include vars from config files ------------------------------------------ 0.08s
Step #2 - "build_xla_docker_image": /ansible/playbook.yaml:25 -----------------------------------------------------
Step #2 - "build_xla_docker_image": Removing intermediate container 9562490230cf
Step #2 - "build_xla_docker_image":  ---> 292bee89b6fe
Step #2 - "build_xla_docker_image": Step 15/22 : WORKDIR /tmp/wheels
Step #2 - "build_xla_docker_image":  ---> Running in afd1a300a424
Step #2 - "build_xla_docker_image": Removing intermediate container afd1a300a424
Step #2 - "build_xla_docker_image":  ---> 968973a7e071
Step #2 - "build_xla_docker_image": Step 16/22 : COPY --from=build /src/pytorch/dist/*.whl ./
Step #2 - "build_xla_docker_image":  ---> 4cd7aa0d7782
Step #2 - "build_xla_docker_image": Step 17/22 : COPY --from=build /src/pytorch/xla/dist/*.whl ./
Step #2 - "build_xla_docker_image":  ---> 28a38677b2f7
Step #2 - "build_xla_docker_image": Step 18/22 : RUN echo "Installing the following wheels" && ls *.whl
Step #2 - "build_xla_docker_image":  ---> Running in 50caa0b96491
Step #2 - "build_xla_docker_image": Installing the following wheels
Step #2 - "build_xla_docker_image": torch-2.1.0-cp310-cp310-linux_x86_64.whl
Step #2 - "build_xla_docker_image": torch_xla-2.1.0-cp310-cp310-manylinux_2_28_x86_64.whl
Step #2 - "build_xla_docker_image": Removing intermediate container 50caa0b96491
Step #2 - "build_xla_docker_image":  ---> 14aed356c3ed
Step #2 - "build_xla_docker_image": Step 19/22 : RUN pip install *.whl
Step #2 - "build_xla_docker_image":  ---> Running in f07dd7c0a853
Step #2 - "build_xla_docker_image": Processing ./torch-2.1.0-cp310-cp310-linux_x86_64.whl
Step #2 - "build_xla_docker_image": Processing ./torch_xla-2.1.0-cp310-cp310-manylinux_2_28_x86_64.whl
Step #2 - "build_xla_docker_image": Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/site-packages (from torch==2.1.0) (3.1.2)
Step #2 - "build_xla_docker_image": Collecting fsspec
Step #2 - "build_xla_docker_image":   Downloading fsspec-2023.9.2-py3-none-any.whl (173 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.4/173.4 kB 5.0 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting filelock
Step #2 - "build_xla_docker_image":   Downloading filelock-3.12.4-py3-none-any.whl (11 kB)
Step #2 - "build_xla_docker_image": Collecting typing-extensions
Step #2 - "build_xla_docker_image":   Downloading typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Step #2 - "build_xla_docker_image": Collecting sympy
Step #2 - "build_xla_docker_image":   Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 34.9 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting networkx
Step #2 - "build_xla_docker_image":   Downloading networkx-3.1-py3-none-any.whl (2.1 MB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 40.4 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (from torch-xla==2.1.0) (6.0.1)
Step #2 - "build_xla_docker_image": Collecting absl-py>=1.0.0
Step #2 - "build_xla_docker_image":   Downloading absl_py-2.0.0-py3-none-any.whl (130 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 130.2/130.2 kB 13.2 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting cloud-tpu-client>=0.10.0
Step #2 - "build_xla_docker_image":   Downloading cloud_tpu_client-0.10-py3-none-any.whl (7.4 kB)
Step #2 - "build_xla_docker_image": Collecting oauth2client
Step #2 - "build_xla_docker_image":   Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.2/98.2 kB 9.9 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting google-api-python-client==1.8.0
Step #2 - "build_xla_docker_image":   Downloading google_api_python_client-1.8.0-py3-none-any.whl (57 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.7/57.7 kB 7.7 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting six<2dev,>=1.6.1
Step #2 - "build_xla_docker_image":   Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Step #2 - "build_xla_docker_image": Collecting google-auth-httplib2>=0.0.3
Step #2 - "build_xla_docker_image":   Downloading google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Step #2 - "build_xla_docker_image": Collecting google-api-core<2dev,>=1.13.0
Step #2 - "build_xla_docker_image":   Downloading google_api_core-1.34.0-py3-none-any.whl (120 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.2/120.2 kB 15.1 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting google-auth>=1.4.1
Step #2 - "build_xla_docker_image":   Downloading google_auth-2.23.3-py2.py3-none-any.whl (182 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 182.3/182.3 kB 16.6 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting httplib2<1dev,>=0.9.2
Step #2 - "build_xla_docker_image":   Downloading httplib2-0.22.0-py3-none-any.whl (96 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.9/96.9 kB 9.5 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting uritemplate<4dev,>=3.0.0
Step #2 - "build_xla_docker_image":   Downloading uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Step #2 - "build_xla_docker_image": Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/site-packages (from jinja2->torch==2.1.0) (2.1.3)
Step #2 - "build_xla_docker_image": Collecting mpmath>=0.19
Step #2 - "build_xla_docker_image":   Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 26.3 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting rsa>=3.1.4
Step #2 - "build_xla_docker_image":   Downloading rsa-4.9-py3-none-any.whl (34 kB)
Step #2 - "build_xla_docker_image": Collecting pyasn1-modules>=0.0.5
Step #2 - "build_xla_docker_image":   Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 19.8 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting pyasn1>=0.1.7
Step #2 - "build_xla_docker_image":   Downloading pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.9/83.9 kB 9.1 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting googleapis-common-protos<2.0dev,>=1.56.2
Step #2 - "build_xla_docker_image":   Downloading googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 230.9/230.9 kB 20.7 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<4.0.0dev,>=3.19.5
Step #2 - "build_xla_docker_image":   Downloading protobuf-3.20.3-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 33.3 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting requests<3.0.0dev,>=2.18.0
Step #2 - "build_xla_docker_image":   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 7.1 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting cachetools<6.0,>=2.0.0
Step #2 - "build_xla_docker_image":   Downloading cachetools-5.3.1-py3-none-any.whl (9.3 kB)
Step #2 - "build_xla_docker_image": Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2
Step #2 - "build_xla_docker_image":   Downloading pyparsing-3.1.1-py3-none-any.whl (103 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.1/103.1 kB 9.7 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting charset-normalizer<4,>=2
Step #2 - "build_xla_docker_image":   Downloading charset_normalizer-3.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 138.7/138.7 kB 15.4 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting urllib3<3,>=1.21.1
Step #2 - "build_xla_docker_image":   Downloading urllib3-2.0.6-py3-none-any.whl (123 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.8/123.8 kB 12.8 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting idna<4,>=2.5
Step #2 - "build_xla_docker_image":   Downloading idna-3.4-py3-none-any.whl (61 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 8.1 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Collecting certifi>=2017.4.17
Step #2 - "build_xla_docker_image":   Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
Step #2 - "build_xla_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 15.1 MB/s eta 0:00:00
Step #2 - "build_xla_docker_image": Installing collected packages: mpmath, urllib3, uritemplate, typing-extensions, sympy, six, pyparsing, pyasn1, protobuf, networkx, idna, fsspec, filelock, charset-normalizer, certifi, cachetools, absl-py, torch, rsa, requests, pyasn1-modules, httplib2, googleapis-common-protos, oauth2client, google-auth, google-auth-httplib2, google-api-core, google-api-python-client, cloud-tpu-client, torch-xla
Step #2 - "build_xla_docker_image": Successfully installed absl-py-2.0.0 cachetools-5.3.1 certifi-2023.7.22 charset-normalizer-3.3.0 cloud-tpu-client-0.10 filelock-3.12.4 fsspec-2023.9.2 google-api-core-1.34.0 google-api-python-client-1.8.0 google-auth-2.23.3 google-auth-httplib2-0.1.1 googleapis-common-protos-1.61.0 httplib2-0.22.0 idna-3.4 mpmath-1.3.0 networkx-3.1 oauth2client-4.1.3 protobuf-3.20.3 pyasn1-0.5.0 pyasn1-modules-0.3.0 pyparsing-3.1.1 requests-2.31.0 rsa-4.9 six-1.16.0 sympy-1.12 torch-2.1.0 torch-xla-2.1.0 typing-extensions-4.8.0 uritemplate-3.0.1 urllib3-2.0.6
Step #2 - "build_xla_docker_image": �[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Step #2 - "build_xla_docker_image": �[0m�[91m
Step #2 - "build_xla_docker_image": [notice] A new release of pip is available: 23.0.1 -> 23.2.1
Step #2 - "build_xla_docker_image": [notice] To update, run: pip install --upgrade pip
Step #2 - "build_xla_docker_image": �[0mRemoving intermediate container f07dd7c0a853
Step #2 - "build_xla_docker_image":  ---> 7c2a895cef86
Step #2 - "build_xla_docker_image": Step 20/22 : WORKDIR /
Step #2 - "build_xla_docker_image":  ---> Running in f8008e6ece66
Step #2 - "build_xla_docker_image": Removing intermediate container f8008e6ece66
Step #2 - "build_xla_docker_image":  ---> dab0b8d174b9
Step #2 - "build_xla_docker_image": Step 21/22 : RUN rm -rf /ansible /tmp/wheels
Step #2 - "build_xla_docker_image":  ---> Running in a1333a9624d1
Step #2 - "build_xla_docker_image": Removing intermediate container a1333a9624d1
Step #2 - "build_xla_docker_image":  ---> 2a3e7edce10d
Step #2 - "build_xla_docker_image": Step 22/22 : COPY --from=build /dist/*.whl /dist/
Step #2 - "build_xla_docker_image":  ---> 3d06e1d4d3f5
Step #2 - "build_xla_docker_image": Successfully built 3d06e1d4d3f5
Step #2 - "build_xla_docker_image": Successfully tagged us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_3.10_cuda_12.1
Step #2 - "build_xla_docker_image": Successfully tagged local_image:latest
Finished Step #2 - "build_xla_docker_image"
Starting Step #3 - "push_xla_docker_image"
Step #3 - "push_xla_docker_image": Already have image (with digest): gcr.io/cloud-builders/docker
Step #3 - "push_xla_docker_image": The push refers to repository [us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla]
Step #3 - "push_xla_docker_image": 84335b83592a: Preparing
Step #3 - "push_xla_docker_image": 54a17ac76e47: Preparing
Step #3 - "push_xla_docker_image": 7a5f78afc5fd: Preparing
Step #3 - "push_xla_docker_image": 8465d8844666: Preparing
Step #3 - "push_xla_docker_image": 66c240905b52: Preparing
Step #3 - "push_xla_docker_image": 1f23b1f13613: Preparing
Step #3 - "push_xla_docker_image": 99fe2d42a8ea: Preparing
Step #3 - "push_xla_docker_image": 917c4e9d73b1: Preparing
Step #3 - "push_xla_docker_image": c72e374588c0: Preparing
Step #3 - "push_xla_docker_image": 59856f3f52dc: Preparing
Step #3 - "push_xla_docker_image": 14c8f86b5c3a: Preparing
Step #3 - "push_xla_docker_image": f5043a2e546c: Preparing
Step #3 - "push_xla_docker_image": 05e9f684d8e8: Preparing
Step #3 - "push_xla_docker_image": bfc6c51b6add: Preparing
Step #3 - "push_xla_docker_image": 2f1b637d38f5: Preparing
Step #3 - "push_xla_docker_image": 09ca2e96f2e3: Preparing
Step #3 - "push_xla_docker_image": 54951a6a1cf0: Preparing
Step #3 - "push_xla_docker_image": 3500a0e921a9: Preparing
Step #3 - "push_xla_docker_image": 917c4e9d73b1: Waiting
Step #3 - "push_xla_docker_image": 14c8f86b5c3a: Waiting
Step #3 - "push_xla_docker_image": f5043a2e546c: Waiting
Step #3 - "push_xla_docker_image": 05e9f684d8e8: Waiting
Step #3 - "push_xla_docker_image": bfc6c51b6add: Waiting
Step #3 - "push_xla_docker_image": c72e374588c0: Waiting
Step #3 - "push_xla_docker_image": 59856f3f52dc: Waiting
Step #3 - "push_xla_docker_image": 1f23b1f13613: Waiting
Step #3 - "push_xla_docker_image": 99fe2d42a8ea: Waiting
Step #3 - "push_xla_docker_image": 2f1b637d38f5: Waiting
Step #3 - "push_xla_docker_image": 3500a0e921a9: Waiting
Step #3 - "push_xla_docker_image": 09ca2e96f2e3: Waiting
Step #3 - "push_xla_docker_image": 54951a6a1cf0: Waiting
Step #3 - "push_xla_docker_image": 54a17ac76e47: Pushed
Step #3 - "push_xla_docker_image": 1f23b1f13613: Pushed
Step #3 - "push_xla_docker_image": 66c240905b52: Pushed
Step #3 - "push_xla_docker_image": 917c4e9d73b1: Pushed
Step #3 - "push_xla_docker_image": 8465d8844666: Pushed
Step #3 - "push_xla_docker_image": 59856f3f52dc: Pushed
Step #3 - "push_xla_docker_image": 14c8f86b5c3a: Layer already exists
Step #3 - "push_xla_docker_image": f5043a2e546c: Layer already exists
Step #3 - "push_xla_docker_image": 05e9f684d8e8: Layer already exists
Step #3 - "push_xla_docker_image": bfc6c51b6add: Layer already exists
Step #3 - "push_xla_docker_image": 2f1b637d38f5: Layer already exists
Step #3 - "push_xla_docker_image": 09ca2e96f2e3: Layer already exists
Step #3 - "push_xla_docker_image": 54951a6a1cf0: Layer already exists
Step #3 - "push_xla_docker_image": 3500a0e921a9: Layer already exists
Step #3 - "push_xla_docker_image": 84335b83592a: Pushed
Step #3 - "push_xla_docker_image": c72e374588c0: Pushed
Step #3 - "push_xla_docker_image": 7a5f78afc5fd: Pushed
Step #3 - "push_xla_docker_image": 99fe2d42a8ea: Pushed
Step #3 - "push_xla_docker_image": r2.1.0_3.10_cuda_12.1: digest: sha256:008cf60e21b2d6bc297e61386d1160a5505c3dd5c8496ac34483a6826e6c20ad size: 4116
Finished Step #3 - "push_xla_docker_image"
Starting Step #4 - "copy_wheels_to_volume"
Step #4 - "copy_wheels_to_volume": Already have image: local_image
Step #4 - "copy_wheels_to_volume": The following wheels will be published
Step #4 - "copy_wheels_to_volume": /dist/torch-2.1.0-cp310-cp310-linux_x86_64.whl
Step #4 - "copy_wheels_to_volume": /dist/torch_xla-2.1.0-cp310-cp310-manylinux_2_28_x86_64.whl
Finished Step #4 - "copy_wheels_to_volume"
Starting Step #5 - "upload_wheels_to_storage_bucket"
Step #5 - "upload_wheels_to_storage_bucket": Already have image (with digest): gcr.io/cloud-builders/gsutil
Step #5 - "upload_wheels_to_storage_bucket": Copying file:///wheels/torch-2.1.0-cp310-cp310-linux_x86_64.whl [Content-Type=application/octet-stream]...
Step #5 - "upload_wheels_to_storage_bucket": / [0 files][    0.0 B/120.8 MiB]                                                
-
- [0 files][113.4 MiB/120.8 MiB]                                                
- [1 files][120.8 MiB/120.8 MiB]                                                
\
Copying file:///wheels/torch_xla-2.1.0-cp310-cp310-manylinux_2_28_x86_64.whl [Content-Type=application/octet-stream]...
Step #5 - "upload_wheels_to_storage_bucket": \ [1 files][120.8 MiB/288.8 MiB]                                                
==> NOTE: You are uploading one or more large file(s), which would run
Step #5 - "upload_wheels_to_storage_bucket": significantly faster if you enable parallel composite uploads. This
Step #5 - "upload_wheels_to_storage_bucket": feature can be enabled by editing the
Step #5 - "upload_wheels_to_storage_bucket": "parallel_composite_upload_threshold" value in your .boto
Step #5 - "upload_wheels_to_storage_bucket": configuration file. However, note that if you do this large files will
Step #5 - "upload_wheels_to_storage_bucket": be uploaded as `composite objects
Step #5 - "upload_wheels_to_storage_bucket": <https://cloud.google.com/storage/docs/composite-objects>`_,which
Step #5 - "upload_wheels_to_storage_bucket": means that any user who downloads such objects will need to have a
Step #5 - "upload_wheels_to_storage_bucket": compiled crcmod installed (see "gsutil help crcmod"). This is because
Step #5 - "upload_wheels_to_storage_bucket": without a compiled crcmod, computing checksums on composite objects is
Step #5 - "upload_wheels_to_storage_bucket": so slow that gsutil disables downloads of composite objects.
Step #5 - "upload_wheels_to_storage_bucket": 
Step #5 - "upload_wheels_to_storage_bucket": |
| [1 files][239.4 MiB/288.8 MiB]                                                
/
/ [2 files][288.8 MiB/288.8 MiB]                                                
Step #5 - "upload_wheels_to_storage_bucket": Operation completed over 2 objects/288.8 MiB.                                    
Finished Step #5 - "upload_wheels_to_storage_bucket"
PUSH
DONE

Build Log: https://console.cloud.google.com/cloud-build/builds;region=us-central1/7b96baba-6132-4ce8-9ac5-6fafb2b15c9f?project=1001674285173