Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fori loop simple case test test #7028

Support pin pr number in new .torch_pin (#6998)

cbbefa2
Select commit
Loading
Failed to load commit list.
Closed

Fori loop simple case test test #7028

Support pin pr number in new .torch_pin (#6998)
cbbefa2
Select commit
Loading
Failed to load commit list.
Google Cloud Build / dev-3-10-tpuvm (tpu-pytorch-releases) succeeded May 1, 2024 in 6m 19s

Summary

Build Information

Trigger dev-3-10-tpuvm
Build 3bcf7d19-a6c2-494a-9a54-c66e636a8e2e
Start 2024-05-01T12:42:39-07:00
Duration 5m33.192s
Status SUCCESS

Steps

Step Status Duration
git_fetch SUCCESS 10.061s
git_checkout SUCCESS 751ms
build_development_docker_image SUCCESS 3m22.342s
push_development_docker_image SUCCESS 1m56.83s

Details

starting build "3bcf7d19-a6c2-494a-9a54-c66e636a8e2e"

FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint: 
hint: 	git config --global init.defaultBranch <name>
hint: 
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint: 
hint: 	git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/pytorch/xla
 * branch            cbbefa2c129ae48c6e868b9eeb4985b6e562dc1c -> FETCH_HEAD
HEAD is now at cbbefa2 Support pin pr number in new .torch_pin (#6998)
BUILD
Starting Step #0 - "git_fetch"
Step #0 - "git_fetch": Already have image (with digest): gcr.io/cloud-builders/git
Step #0 - "git_fetch": From https://github.com/pytorch/xla
Step #0 - "git_fetch":  * [new branch]          01172023_pin_update     -> origin/01172023_pin_update
Step #0 - "git_fetch":  * [new branch]          2-0-python-3-10         -> origin/2-0-python-3-10
Step #0 - "git_fetch":  * [new branch]          4483-improve-resnet50-data-loading-performance -> origin/4483-improve-resnet50-data-loading-performance
Step #0 - "git_fetch":  * [new branch]          5d-unit-test            -> origin/5d-unit-test
Step #0 - "git_fetch":  * [new branch]          AddVimToReleasePackage  -> origin/AddVimToReleasePackage
Step #0 - "git_fetch":  * [new branch]          FixTransferToServer     -> origin/FixTransferToServer
Step #0 - "git_fetch":  * [new branch]          JackCaaoG/spmd_device_python_test -> origin/JackCaaoG/spmd_device_python_test
Step #0 - "git_fetch":  * [new branch]          JackCao/Disable_hlo_dump_test_on_tpu -> origin/JackCao/Disable_hlo_dump_test_on_tpu
Step #0 - "git_fetch":  * [new branch]          JackCao/Dynamo_sync_input_counter -> origin/JackCao/Dynamo_sync_input_counter
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_1 -> origin/JackCao/cherry_pick_dynamo_1
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_2 -> origin/JackCao/cherry_pick_dynamo_2
Step #0 - "git_fetch":  * [new branch]          JackCao/cherry_pick_dynamo_3 -> origin/JackCao/cherry_pick_dynamo_3
Step #0 - "git_fetch":  * [new branch]          JackCao/spmd_python_device -> origin/JackCao/spmd_python_device
Step #0 - "git_fetch":  * [new branch]          JackCao/unordered_sharding_spec -> origin/JackCao/unordered_sharding_spec
Step #0 - "git_fetch":  * [new branch]          JackCao/update_to_2.0   -> origin/JackCao/update_to_2.0
Step #0 - "git_fetch":  * [new branch]          JackCao/update_to_223   -> origin/JackCao/update_to_223
Step #0 - "git_fetch":  * [new branch]          JackCao/workaround_einsum_faketensor -> origin/JackCao/workaround_einsum_faketensor
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-1        -> origin/JackCaoG-patch-1
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-2        -> origin/JackCaoG-patch-2
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-3        -> origin/JackCaoG-patch-3
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-4        -> origin/JackCaoG-patch-4
Step #0 - "git_fetch":  * [new branch]          JackCaoG-patch-5        -> origin/JackCaoG-patch-5
Step #0 - "git_fetch":  * [new branch]          JackCaoG-remove-pin     -> origin/JackCaoG-remove-pin
Step #0 - "git_fetch":  * [new branch]          JackCaoG/1_13_revert_addcmul -> origin/JackCaoG/1_13_revert_addcmul
Step #0 - "git_fetch":  * [new branch]          JackCaoG/2.0_patch      -> origin/JackCaoG/2.0_patch
Step #0 - "git_fetch":  * [new branch]          JackCaoG/AddDynamoSpmdMetrics -> origin/JackCaoG/AddDynamoSpmdMetrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/CI_build_cpp_test -> origin/JackCaoG/CI_build_cpp_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Dyanmo_execute_async -> origin/JackCaoG/Dyanmo_execute_async
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Dynamo_training_test -> origin/JackCaoG/Dynamo_training_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/PJRT_wait_buffer_sync -> origin/JackCaoG/PJRT_wait_buffer_sync
Step #0 - "git_fetch":  * [new branch]          JackCaoG/SPMD_execute_metrics -> origin/JackCaoG/SPMD_execute_metrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/SPMD_int_to_cpu -> origin/JackCaoG/SPMD_int_to_cpu
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Update_short_metrics -> origin/JackCaoG/Update_short_metrics
Step #0 - "git_fetch":  * [new branch]          JackCaoG/Update_wheel_docker_to_table -> origin/JackCaoG/Update_wheel_docker_to_table
Step #0 - "git_fetch":  * [new branch]          JackCaoG/XLAShardedTensor_torch_dispatch -> origin/JackCaoG/XLAShardedTensor_torch_dispatch
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_2_1_py311_build -> origin/JackCaoG/add_2_1_py311_build
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_dynamo_test_counter_check -> origin/JackCaoG/add_dynamo_test_counter_check
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_dynamo_test_to_tpu_ci -> origin/JackCaoG/add_dynamo_test_to_tpu_ci
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_gpu_doc    -> origin/JackCaoG/add_gpu_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_gpu_doc_readme -> origin/JackCaoG/add_gpu_doc_readme
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_test_dynamo_graph_dump -> origin/JackCaoG/add_test_dynamo_graph_dump
Step #0 - "git_fetch":  * [new branch]          JackCaoG/add_test_print -> origin/JackCaoG/add_test_print
Step #0 - "git_fetch":  * [new branch]          JackCaoG/api_init_runtime -> origin/JackCaoG/api_init_runtime
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backout_22_mesh_spmd -> origin/JackCaoG/backout_22_mesh_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_allgather_out -> origin/JackCaoG/backport_22_allgather_out
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_diagonal_scatter -> origin/JackCaoG/backport_22_diagonal_scatter
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_doc -> origin/JackCaoG/backport_22_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_reduce_scatter -> origin/JackCaoG/backport_22_reduce_scatter
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_reducescatter_out -> origin/JackCaoG/backport_22_reducescatter_out
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_scalar -> origin/JackCaoG/backport_22_scalar
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_22_transfer_gpu_scalar -> origin/JackCaoG/backport_22_transfer_gpu_scalar
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_aws_zero1 -> origin/JackCaoG/backport_aws_zero1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_dynamo_cpu_move -> origin/JackCaoG/backport_dynamo_cpu_move
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_dynamo_doc_eval -> origin/JackCaoG/backport_dynamo_doc_eval
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_flash_attention_dynamo -> origin/JackCaoG/backport_flash_attention_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_frame_count -> origin/JackCaoG/backport_frame_count
Step #0 - "git_fetch":  * [new branch]          JackCaoG/backport_oerserve_rng -> origin/JackCaoG/backport_oerserve_rng
Step #0 - "git_fetch":  * [new branch]          JackCaoG/barrier_comment -> origin/JackCaoG/barrier_comment
Step #0 - "git_fetch":  * [new branch]          JackCaoG/better_dynamo_error_message -> origin/JackCaoG/better_dynamo_error_message
Step #0 - "git_fetch":  * [new branch]          JackCaoG/buffer_donor_custom_op -> origin/JackCaoG/buffer_donor_custom_op
Step #0 - "git_fetch":  * [new branch]          JackCaoG/build_audio_whl -> origin/JackCaoG/build_audio_whl
Step #0 - "git_fetch":  * [new branch]          JackCaoG/bump+gpu_coverage_timeout -> origin/JackCaoG/bump+gpu_coverage_timeout
Step #0 - "git_fetch":  * [new branch]          JackCaoG/bump_build_timeout -> origin/JackCaoG/bump_build_timeout
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cache_sharded_placeholder_dynamo -> origin/JackCaoG/cache_sharded_placeholder_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cherry_pick_dynamo_test -> origin/JackCaoG/cherry_pick_dynamo_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cherry_pick_frame_count -> origin/JackCaoG/cherry_pick_frame_count
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cherry_picl_xrt_crash_2.1 -> origin/JackCaoG/cherry_picl_xrt_crash_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/clang-format-11 -> origin/JackCaoG/clang-format-11
Step #0 - "git_fetch":  * [new branch]          JackCaoG/clang-format-11-2 -> origin/JackCaoG/clang-format-11-2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/clean_up_gettensor -> origin/JackCaoG/clean_up_gettensor
Step #0 - "git_fetch":  * [new branch]          JackCaoG/clean_up_use_virtual_device -> origin/JackCaoG/clean_up_use_virtual_device
Step #0 - "git_fetch":  * [new branch]          JackCaoG/cleanup_docs   -> origin/JackCaoG/cleanup_docs
Step #0 - "git_fetch":  * [new branch]          JackCaoG/colab_whl_abi  -> origin/JackCaoG/colab_whl_abi
Step #0 - "git_fetch":  * [new branch]          JackCaoG/colab_whl_abi_2 -> origin/JackCaoG/colab_whl_abi_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/data_to_string -> origin/JackCaoG/data_to_string
Step #0 - "git_fetch":  * [new branch]          JackCaoG/debug_fix      -> origin/JackCaoG/debug_fix
Step #0 - "git_fetch":  * [new branch]          JackCaoG/debug_tool     -> origin/JackCaoG/debug_tool
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_coverage -> origin/JackCaoG/disable_coverage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_dynamo_different_shape_test -> origin/JackCaoG/disable_dynamo_different_shape_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_flaky_test -> origin/JackCaoG/disable_flaky_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_flaky_test_2 -> origin/JackCaoG/disable_flaky_test_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_flaky_test_3 -> origin/JackCaoG/disable_flaky_test_3
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_more_dynamic -> origin/JackCaoG/disable_more_dynamic
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_more_dynamic_test -> origin/JackCaoG/disable_more_dynamic_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_pjrt_computation_client_test -> origin/JackCaoG/disable_pjrt_computation_client_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disable_test_xla_sharding -> origin/JackCaoG/disable_test_xla_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/disbale_docker_sandbox -> origin/JackCaoG/disbale_docker_sandbox
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dump_output_sharding -> origin/JackCaoG/dump_output_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_2.0_cherry_pick -> origin/JackCaoG/dynamo_2.0_cherry_pick
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_aliasing_2 -> origin/JackCaoG/dynamo_aliasing_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_debug_message -> origin/JackCaoG/dynamo_debug_message
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_different_graph -> origin/JackCaoG/dynamo_different_graph
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_do_not_markstep_to_sync_input -> origin/JackCaoG/dynamo_do_not_markstep_to_sync_input
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_doc     -> origin/JackCaoG/dynamo_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_dump_tensor_file -> origin/JackCaoG/dynamo_dump_tensor_file
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_note_backport_2.1 -> origin/JackCaoG/dynamo_note_backport_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_only_warm_up_cache -> origin/JackCaoG/dynamo_only_warm_up_cache
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_optimizer -> origin/JackCaoG/dynamo_optimizer
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_reduce_execute -> origin/JackCaoG/dynamo_reduce_execute
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_rng_seed_without_mark_step -> origin/JackCaoG/dynamo_rng_seed_without_mark_step
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd    -> origin/JackCaoG/dynamo_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd_input_sharding_change -> origin/JackCaoG/dynamo_spmd_input_sharding_change
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_spmd_optimization -> origin/JackCaoG/dynamo_spmd_optimization
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_sync_input -> origin/JackCaoG/dynamo_sync_input
Step #0 - "git_fetch":  * [new branch]          JackCaoG/dynamo_warning -> origin/JackCaoG/dynamo_warning
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_cumsum_long -> origin/JackCaoG/enable_cumsum_long
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_dynamo_upstream_test -> origin/JackCaoG/enable_dynamo_upstream_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_fsdp_gpu_test -> origin/JackCaoG/enable_fsdp_gpu_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_mp_test_on_tpuci -> origin/JackCaoG/enable_mp_test_on_tpuci
Step #0 - "git_fetch":  * [new branch]          JackCaoG/enable_reduce_scatter_test_gpu -> origin/JackCaoG/enable_reduce_scatter_test_gpu
Step #0 - "git_fetch":  * [new branch]          JackCaoG/example_torch_pin_pr -> origin/JackCaoG/example_torch_pin_pr
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_cc_linter_once -> origin/JackCaoG/fix_cc_linter_once
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_deprecated_test_oepration_api -> origin/JackCaoG/fix_deprecated_test_oepration_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_diagonal_scatter_dim -> origin/JackCaoG/fix_diagonal_scatter_dim
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dyanmo_additional_tracing -> origin/JackCaoG/fix_dyanmo_additional_tracing
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo     -> origin/JackCaoG/fix_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_crash -> origin/JackCaoG/fix_dynamo_crash
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_crash_profiler -> origin/JackCaoG/fix_dynamo_crash_profiler
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_inplace -> origin/JackCaoG/fix_dynamo_inplace
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_input_sharding_test -> origin/JackCaoG/fix_dynamo_input_sharding_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_dynamo_text_allclose -> origin/JackCaoG/fix_dynamo_text_allclose
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_full_dtype -> origin/JackCaoG/fix_full_dtype
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_hlo_dump   -> origin/JackCaoG/fix_hlo_dump
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_hlo_dump_spmd -> origin/JackCaoG/fix_hlo_dump_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_log_spam   -> origin/JackCaoG/fix_log_spam
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_mark_step_on_spmd_device -> origin/JackCaoG/fix_mark_step_on_spmd_device
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_mp_save_test -> origin/JackCaoG/fix_mp_save_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_send_cpu_data -> origin/JackCaoG/fix_send_cpu_data
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_spmd_buff_is_null -> origin/JackCaoG/fix_spmd_buff_is_null
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_tpu_ci_accuracy -> origin/JackCaoG/fix_tpu_ci_accuracy
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_typo       -> origin/JackCaoG/fix_typo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_vision_build -> origin/JackCaoG/fix_vision_build
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fix_warning_message -> origin/JackCaoG/fix_warning_message
Step #0 - "git_fetch":  * [new branch]          JackCaoG/flash_attention_custom_op -> origin/JackCaoG/flash_attention_custom_op
Step #0 - "git_fetch":  * [new branch]          JackCaoG/flash_attention_test_precision -> origin/JackCaoG/flash_attention_test_precision
Step #0 - "git_fetch":  * [new branch]          JackCaoG/fsdp_autowrap_test -> origin/JackCaoG/fsdp_autowrap_test
Step #0 - "git_fetch":  * [new branch]          JackCaoG/gpu_build_pytorch_cuda -> origin/JackCaoG/gpu_build_pytorch_cuda
Step #0 - "git_fetch":  * [new branch]          JackCaoG/graph_hash_debug -> origin/JackCaoG/graph_hash_debug
Step #0 - "git_fetch":  * [new branch]          JackCaoG/handle_dynamo_fn_without_arg -> origin/JackCaoG/handle_dynamo_fn_without_arg
Step #0 - "git_fetch":  * [new branch]          JackCaoG/improve_data_tostring -> origin/JackCaoG/improve_data_tostring
Step #0 - "git_fetch":  * [new branch]          JackCaoG/increase_timeout_docker -> origin/JackCaoG/increase_timeout_docker
Step #0 - "git_fetch":  * [new branch]          JackCaoG/ir_value_sharding -> origin/JackCaoG/ir_value_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/lower_dropout_backward -> origin/JackCaoG/lower_dropout_backward
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_op_lowering_guide -> origin/JackCaoG/move_op_lowering_guide
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_pin_2_0   -> origin/JackCaoG/move_pin_2_0
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_pjrt_lock_location -> origin/JackCaoG/move_pjrt_lock_location
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_return_future -> origin/JackCaoG/move_return_future
Step #0 - "git_fetch":  * [new branch]          JackCaoG/move_test_grad_checkpoint_to_tpu -> origin/JackCaoG/move_test_grad_checkpoint_to_tpu
Step #0 - "git_fetch":  * [new branch]          JackCaoG/new_alias_api  -> origin/JackCaoG/new_alias_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/nightly_build_python -> origin/JackCaoG/nightly_build_python
Step #0 - "git_fetch":  * [new branch]          JackCaoG/parallel_spmd  -> origin/JackCaoG/parallel_spmd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pin_expecttest -> origin/JackCaoG/pin_expecttest
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pin_update_20230808 -> origin/JackCaoG/pin_update_20230808
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pt_xla_debug_5 -> origin/JackCaoG/pt_xla_debug_5
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pt_xla_debug_dynamo_execute -> origin/JackCaoG/pt_xla_debug_dynamo_execute
Step #0 - "git_fetch":  * [new branch]          JackCaoG/pt_xla_debug_max_frame -> origin/JackCaoG/pt_xla_debug_max_frame
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r20_backportdoc -> origin/JackCaoG/r20_backportdoc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_ABI_0     -> origin/JackCaoG/r2_0_ABI_0
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_back_port_profile_flag -> origin/JackCaoG/r2_0_back_port_profile_flag
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_backport_loader_thread -> origin/JackCaoG/r2_0_backport_loader_thread
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_backport_loader_thread_2 -> origin/JackCaoG/r2_0_backport_loader_thread_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/r2_0_cherry_pick_defer_init -> origin/JackCaoG/r2_0_cherry_pick_defer_init
Step #0 - "git_fetch":  * [new branch]          JackCaoG/remove_pin     -> origin/JackCaoG/remove_pin
Step #0 - "git_fetch":  * [new branch]          JackCaoG/remove_reshape_again -> origin/JackCaoG/remove_reshape_again
Step #0 - "git_fetch":  * [new branch]          JackCaoG/remove_reshape_lowering -> origin/JackCaoG/remove_reshape_lowering
Step #0 - "git_fetch":  * [new branch]          JackCaoG/restrict_mark_sharding -> origin/JackCaoG/restrict_mark_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/revert_addcmul -> origin/JackCaoG/revert_addcmul
Step #0 - "git_fetch":  * [new branch]          JackCaoG/revert_protobuf_tf_patch -> origin/JackCaoG/revert_protobuf_tf_patch
Step #0 - "git_fetch":  * [new branch]          JackCaoG/shard_device_data_ir -> origin/JackCaoG/shard_device_data_ir
Step #0 - "git_fetch":  * [new branch]          JackCaoG/skip_partitioner -> origin/JackCaoG/skip_partitioner
Step #0 - "git_fetch":  * [new branch]          JackCaoG/skip_tpu_test_precision -> origin/JackCaoG/skip_tpu_test_precision
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_aliasing  -> origin/JackCaoG/spmd_aliasing
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_dynamo_sharding_changed -> origin/JackCaoG/spmd_dynamo_sharding_changed
Step #0 - "git_fetch":  * [new branch]          JackCaoG/spmd_incorrect_result -> origin/JackCaoG/spmd_incorrect_result
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tensor_debugging_api -> origin/JackCaoG/tensor_debugging_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tensor_with_xla_data_sharding -> origin/JackCaoG/tensor_with_xla_data_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaoG/test_torch_compile_usage -> origin/JackCaoG/test_torch_compile_usage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tf_update_20230201 -> origin/JackCaoG/tf_update_20230201
Step #0 - "git_fetch":  * [new branch]          JackCaoG/tracing_timer  -> origin/JackCaoG/tracing_timer
Step #0 - "git_fetch":  * [new branch]          JackCaoG/trouble_shooting_update -> origin/JackCaoG/trouble_shooting_update
Step #0 - "git_fetch":  * [new branch]          JackCaoG/truncate_python_stack -> origin/JackCaoG/truncate_python_stack
Step #0 - "git_fetch":  * [new branch]          JackCaoG/unordered_partial_sharding_spec -> origin/JackCaoG/unordered_partial_sharding_spec
Step #0 - "git_fetch":  * [new branch]          JackCaoG/updateDocker   -> origin/JackCaoG/updateDocker
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_2_0_ABI -> origin/JackCaoG/update_2_0_ABI
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_API_GUIDE -> origin/JackCaoG/update_API_GUIDE
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_XLA_IR_SHAPE_CACHE_SIZE -> origin/JackCaoG/update_XLA_IR_SHAPE_CACHE_SIZE
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_build_guide -> origin/JackCaoG/update_build_guide
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_colab_2_10_whl -> origin/JackCaoG/update_colab_2_10_whl
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_doc1    -> origin/JackCaoG/update_doc1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_doc_remove_xrt -> origin/JackCaoG/update_doc_remove_xrt
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_docker_instruction -> origin/JackCaoG/update_docker_instruction
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_backend_name -> origin/JackCaoG/update_dynamo_backend_name
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_backend_nograd -> origin/JackCaoG/update_dynamo_backend_nograd
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_counter_check -> origin/JackCaoG/update_dynamo_counter_check
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_doc -> origin/JackCaoG/update_dynamo_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_doc_to_remove_eval -> origin/JackCaoG/update_dynamo_doc_to_remove_eval
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_number_2.1 -> origin/JackCaoG/update_dynamo_number_2.1
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_readme -> origin/JackCaoG/update_dynamo_readme
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_save_graph_path -> origin/JackCaoG/update_dynamo_save_graph_path
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_torch_equal -> origin/JackCaoG/update_dynamo_torch_equal
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_dynamo_training_compile_count -> origin/JackCaoG/update_dynamo_training_compile_count
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_dev -> origin/JackCaoG/update_gpu_dev
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_doc -> origin/JackCaoG/update_gpu_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_wheel_link -> origin/JackCaoG/update_gpu_wheel_link
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_gpu_wheellink -> origin/JackCaoG/update_gpu_wheellink
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_pjrt_future -> origin/JackCaoG/update_pjrt_future
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_readme_2 -> origin/JackCaoG/update_readme_2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_set_default_tensor_type -> origin/JackCaoG/update_set_default_tensor_type
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_tf_2023018 -> origin/JackCaoG/update_tf_2023018
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_to_2.2  -> origin/JackCaoG/update_to_2.2
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_to_223  -> origin/JackCaoG/update_to_223
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_torch_compile_usage -> origin/JackCaoG/update_torch_compile_usage
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_trouble_shotting_doc -> origin/JackCaoG/update_trouble_shotting_doc
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_troubleshotting_with_sanitycheck -> origin/JackCaoG/update_troubleshotting_with_sanitycheck
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_wheel_docker_format -> origin/JackCaoG/update_wheel_docker_format
Step #0 - "git_fetch":  * [new branch]          JackCaoG/update_xla_pin_040922024 -> origin/JackCaoG/update_xla_pin_040922024
Step #0 - "git_fetch":  * [new branch]          JackCaoG/use_new_alias_api -> origin/JackCaoG/use_new_alias_api
Step #0 - "git_fetch":  * [new branch]          JackCaoG/weak_ref_dynamo -> origin/JackCaoG/weak_ref_dynamo
Step #0 - "git_fetch":  * [new branch]          JackCaoG/xrt_cherry_pick_07_10 -> origin/JackCaoG/xrt_cherry_pick_07_10
Step #0 - "git_fetch":  * [new branch]          JackCaoG/xrt_cherrypick_0721 -> origin/JackCaoG/xrt_cherrypick_0721
Step #0 - "git_fetch":  * [new branch]          JackCaog/dynamo_input_sharding -> origin/JackCaog/dynamo_input_sharding
Step #0 - "git_fetch":  * [new branch]          JackCaog/quick_spmd_fix -> origin/JackCaog/quick_spmd_fix
Step #0 - "git_fetch":  * [new branch]          JackCaog/spmd_device_default -> origin/JackCaog/spmd_device_default
Step #0 - "git_fetch":  * [new branch]          Liyang90-patch-1        -> origin/Liyang90-patch-1
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-1       -> origin/ManfeiBai-patch-1
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-10      -> origin/ManfeiBai-patch-10
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-11      -> origin/ManfeiBai-patch-11
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-12      -> origin/ManfeiBai-patch-12
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-13      -> origin/ManfeiBai-patch-13
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-14      -> origin/ManfeiBai-patch-14
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-15      -> origin/ManfeiBai-patch-15
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-16      -> origin/ManfeiBai-patch-16
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-17      -> origin/ManfeiBai-patch-17
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-18      -> origin/ManfeiBai-patch-18
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-19      -> origin/ManfeiBai-patch-19
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-2       -> origin/ManfeiBai-patch-2
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-20      -> origin/ManfeiBai-patch-20
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-21      -> origin/ManfeiBai-patch-21
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-22      -> origin/ManfeiBai-patch-22
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-23      -> origin/ManfeiBai-patch-23
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-24      -> origin/ManfeiBai-patch-24
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-25      -> origin/ManfeiBai-patch-25
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-26      -> origin/ManfeiBai-patch-26
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-27      -> origin/ManfeiBai-patch-27
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-28      -> origin/ManfeiBai-patch-28
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-29      -> origin/ManfeiBai-patch-29
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-3       -> origin/ManfeiBai-patch-3
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-30      -> origin/ManfeiBai-patch-30
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-31      -> origin/ManfeiBai-patch-31
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-32      -> origin/ManfeiBai-patch-32
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-33      -> origin/ManfeiBai-patch-33
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-34      -> origin/ManfeiBai-patch-34
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-35      -> origin/ManfeiBai-patch-35
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-36      -> origin/ManfeiBai-patch-36
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-37      -> origin/ManfeiBai-patch-37
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-38      -> origin/ManfeiBai-patch-38
Step #0 - "git_fetch":  * [new branch]          ManfeiBai-patch-39      -> origin/ManfeiBai-patch-39
Step #0 - "gi
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/cloud-build/builds;region=us-central1/3bcf7d19-a6c2-494a-9a54-c66e636a8e2e?project=1001674285173.]
...
d_development_docker_image":   Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
Step #2 - "build_development_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 54.0 MB/s eta 0:00:00
Step #2 - "build_development_docker_image": Collecting resolvelib<1.1.0,>=0.5.3
Step #2 - "build_development_docker_image":   Downloading resolvelib-1.0.1-py2.py3-none-any.whl (17 kB)
Step #2 - "build_development_docker_image": Collecting cryptography
Step #2 - "build_development_docker_image":   Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
Step #2 - "build_development_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 72.2 MB/s eta 0:00:00
Step #2 - "build_development_docker_image": Collecting jinja2>=3.0.0
Step #2 - "build_development_docker_image":   Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
Step #2 - "build_development_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 21.5 MB/s eta 0:00:00
Step #2 - "build_development_docker_image": Collecting MarkupSafe>=2.0
Step #2 - "build_development_docker_image":   Downloading MarkupSafe-2.1.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Step #2 - "build_development_docker_image": Collecting cffi>=1.12
Step #2 - "build_development_docker_image":   Downloading cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB)
Step #2 - "build_development_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 443.9/443.9 kB 50.4 MB/s eta 0:00:00
Step #2 - "build_development_docker_image": Collecting pycparser
Step #2 - "build_development_docker_image":   Downloading pycparser-2.22-py3-none-any.whl (117 kB)
Step #2 - "build_development_docker_image":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.6/117.6 kB 18.0 MB/s eta 0:00:00
Step #2 - "build_development_docker_image": Installing collected packages: resolvelib, PyYAML, pycparser, packaging, MarkupSafe, jinja2, cffi, cryptography, ansible-core, ansible
Step #2 - "build_development_docker_image": Successfully installed MarkupSafe-2.1.5 PyYAML-6.0.1 ansible-9.5.1 ansible-core-2.16.6 cffi-1.16.0 cryptography-42.0.5 jinja2-3.1.3 packaging-24.0 pycparser-2.22 resolvelib-1.0.1
Step #2 - "build_development_docker_image": �[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Step #2 - "build_development_docker_image": �[0m�[91m
Step #2 - "build_development_docker_image": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #2 - "build_development_docker_image": [notice] To update, run: pip install --upgrade pip
Step #2 - "build_development_docker_image": �[0mRemoving intermediate container f7414547d1e1
Step #2 - "build_development_docker_image":  ---> 97dede906289
Step #2 - "build_development_docker_image": Step 5/10 : COPY . /ansible
Step #2 - "build_development_docker_image":  ---> 226d033addad
Step #2 - "build_development_docker_image": Step 6/10 : WORKDIR /ansible
Step #2 - "build_development_docker_image":  ---> Running in 3238e9d2e2fd
Step #2 - "build_development_docker_image": Removing intermediate container 3238e9d2e2fd
Step #2 - "build_development_docker_image":  ---> a26e4f4f090e
Step #2 - "build_development_docker_image": Step 7/10 : ENV TAGS="bazel,configure_env,install_deps"
Step #2 - "build_development_docker_image":  ---> Running in f518678b7a42
Step #2 - "build_development_docker_image": Removing intermediate container f518678b7a42
Step #2 - "build_development_docker_image":  ---> 211fa32e9812
Step #2 - "build_development_docker_image": Step 8/10 : ARG ansible_vars
Step #2 - "build_development_docker_image":  ---> Running in 41beff8651fe
Step #2 - "build_development_docker_image": Removing intermediate container 41beff8651fe
Step #2 - "build_development_docker_image":  ---> 6251b614eec7
Step #2 - "build_development_docker_image": Step 9/10 : RUN ansible-playbook playbook.yaml -e "stage=build" -e "${ansible_vars}" --tags "${TAGS}"
Step #2 - "build_development_docker_image":  ---> Running in e47306e1dffd
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": PLAY [Install build dependencies] **********************************************
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [Gathering Facts] *********************************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:54 +0000 (0:00:00.026)       0:00:00.026 ********* 
Step #2 - "build_development_docker_image": ok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [Include vars from config files] ******************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:56 +0000 (0:00:01.128)       0:00:01.155 ********* 
Step #2 - "build_development_docker_image": ok: [localhost] => (item=vars.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=cuda_deps.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=apt.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=pip.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=env.yaml)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Download bazelisk v1.15.0] ***************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:56 +0000 (0:00:00.079)       0:00:01.234 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Tests] ***********************************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:57 +0000 (0:00:00.986)       0:00:02.220 ********* 
Step #2 - "build_development_docker_image": included: /ansible/roles/bazel/tasks/tests.yaml for localhost
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Bazel --version runs succesfully] ********************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:57 +0000 (0:00:00.030)       0:00:02.250 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Add apt keys] *********************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:57 +0000 (0:00:00.766)       0:00:03.017 ********* 
Step #2 - "build_development_docker_image": changed: [localhost] => (item={'url': 'https://apt.llvm.org/llvm-snapshot.gpg.key', 'keyring': '/usr/share/keyrings/llvm.pgp'})
Step #2 - "build_development_docker_image": changed: [localhost] => (item={'url': 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/3bf863cc.pub', 'keyring': '/usr/share/keyrings/cuda.pgp'})
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Add apt repositories into sources list] *******************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:43:58 +0000 (0:00:00.925)       0:00:03.942 ********* 
Step #2 - "build_development_docker_image": changed: [localhost] => (item=deb [signed-by=/usr/share/keyrings/llvm.pgp] http://apt.llvm.org/bullseye/ llvm-toolchain-bullseye-17 main)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=deb-src [signed-by=/usr/share/keyrings/llvm.pgp] http://apt.llvm.org/bullseye/ llvm-toolchain-bullseye-17 main)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=deb [signed-by=/usr/share/keyrings/cuda.pgp] https://developer.download.nvidia.com/compute/cuda/repos/debian11/x86_64/ /)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Update apt cache] *****************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:44:11 +0000 (0:00:12.683)       0:00:16.626 ********* 
Step #2 - "build_development_docker_image": ok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install apt packages] *************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:44:15 +0000 (0:00:03.693)       0:00:20.319 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install pip packages] *************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:44:36 +0000 (0:00:21.078)       0:00:41.398 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install pip packages without deps (--no-deps)] ************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:23 +0000 (0:00:47.474)       0:01:28.873 ********* 
Step #2 - "build_development_docker_image": �[91m[WARNING]: No valid name or requirements file found.
Step #2 - "build_development_docker_image": �[0mok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [configure_env : Append environment variables required during runtime to ~/.bashrc] ***
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:24 +0000 (0:00:00.459)       0:01:29.333 ********* 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=CC) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=CXX) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=LD_LIBRARY_PATH) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=ACCELERATOR) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=TPUVM_MODE) 
Step #2 - "build_development_docker_image": skipping: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [configure_env : Append environment variables required during runtime to ~/.zshrc] ***
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:24 +0000 (0:00:00.075)       0:01:29.408 ********* 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=CC) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=CXX) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=LD_LIBRARY_PATH) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=ACCELERATOR) 
Step #2 - "build_development_docker_image": skipping: [localhost] => (item=TPUVM_MODE) 
Step #2 - "build_development_docker_image": skipping: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": PLAY RECAP *********************************************************************
Step #2 - "build_development_docker_image": localhost                  : ok=11   changed=6    unreachable=0    failed=0    skipped=2    rescued=0    ignored=0   
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:24 +0000 (0:00:00.093)       0:01:29.501 ********* 
Step #2 - "build_development_docker_image": =============================================================================== 
Step #2 - "build_development_docker_image": install_deps : Install pip packages ------------------------------------ 47.47s
Step #2 - "build_development_docker_image": install_deps : Install apt packages ------------------------------------ 21.08s
Step #2 - "build_development_docker_image": install_deps : Add apt repositories into sources list ------------------ 12.68s
Step #2 - "build_development_docker_image": install_deps : Update apt cache ----------------------------------------- 3.69s
Step #2 - "build_development_docker_image": Gathering Facts --------------------------------------------------------- 1.13s
Step #2 - "build_development_docker_image": bazel : Download bazelisk v1.15.0 --------------------------------------- 0.99s
Step #2 - "build_development_docker_image": install_deps : Add apt keys --------------------------------------------- 0.93s
Step #2 - "build_development_docker_image": bazel : Bazel --version runs succesfully -------------------------------- 0.77s
Step #2 - "build_development_docker_image": install_deps : Install pip packages without deps (--no-deps) ------------ 0.46s
Step #2 - "build_development_docker_image": configure_env : Append environment variables required during runtime to ~/.zshrc --- 0.09s
Step #2 - "build_development_docker_image": Include vars from config files ------------------------------------------ 0.08s
Step #2 - "build_development_docker_image": configure_env : Append environment variables required during runtime to ~/.bashrc --- 0.08s
Step #2 - "build_development_docker_image": bazel : Tests ----------------------------------------------------------- 0.03s
Step #2 - "build_development_docker_image": Removing intermediate container e47306e1dffd
Step #2 - "build_development_docker_image":  ---> 5142d42d8bea
Step #2 - "build_development_docker_image": Step 10/10 : RUN ansible-playbook playbook.yaml -e "stage=release" -e "${ansible_vars}" --tags "${TAGS}"
Step #2 - "build_development_docker_image":  ---> Running in bc8b1f1e2d2e
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": PLAY [Install build dependencies] **********************************************
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [Gathering Facts] *********************************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:45 +0000 (0:00:00.024)       0:00:00.024 ********* 
Step #2 - "build_development_docker_image": ok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [Include vars from config files] ******************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:46 +0000 (0:00:01.296)       0:00:01.321 ********* 
Step #2 - "build_development_docker_image": ok: [localhost] => (item=vars.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=cuda_deps.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=apt.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=pip.yaml)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=env.yaml)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Download bazelisk v1.15.0] ***************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:46 +0000 (0:00:00.085)       0:00:01.406 ********* 
Step #2 - "build_development_docker_image": ok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Tests] ***********************************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:47 +0000 (0:00:00.949)       0:00:02.355 ********* 
Step #2 - "build_development_docker_image": included: /ansible/roles/bazel/tasks/tests.yaml for localhost
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [bazel : Bazel --version runs succesfully] ********************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:47 +0000 (0:00:00.035)       0:00:02.390 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Add apt keys] *********************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:48 +0000 (0:00:00.707)       0:00:03.098 ********* 
Step #2 - "build_development_docker_image": ok: [localhost] => (item={'url': 'https://apt.llvm.org/llvm-snapshot.gpg.key', 'keyring': '/usr/share/keyrings/llvm.pgp'})
Step #2 - "build_development_docker_image": ok: [localhost] => (item={'url': 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/3bf863cc.pub', 'keyring': '/usr/share/keyrings/cuda.pgp'})
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Add apt repositories into sources list] *******************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:50 +0000 (0:00:01.515)       0:00:04.614 ********* 
Step #2 - "build_development_docker_image": ok: [localhost] => (item=deb [signed-by=/usr/share/keyrings/llvm.pgp] http://apt.llvm.org/bullseye/ llvm-toolchain-bullseye-17 main)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=deb-src [signed-by=/usr/share/keyrings/llvm.pgp] http://apt.llvm.org/bullseye/ llvm-toolchain-bullseye-17 main)
Step #2 - "build_development_docker_image": ok: [localhost] => (item=deb [signed-by=/usr/share/keyrings/cuda.pgp] https://developer.download.nvidia.com/compute/cuda/repos/debian11/x86_64/ /)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Update apt cache] *****************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:53 +0000 (0:00:03.047)       0:00:07.661 ********* 
Step #2 - "build_development_docker_image": skipping: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install apt packages] *************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:45:53 +0000 (0:00:00.027)       0:00:07.688 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install pip packages] *************************************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:46:01 +0000 (0:00:07.890)       0:00:15.579 ********* 
Step #2 - "build_development_docker_image": changed: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [install_deps : Install pip packages without deps (--no-deps)] ************
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:46:07 +0000 (0:00:06.253)       0:00:21.832 ********* 
Step #2 - "build_development_docker_image": �[91m[WARNING]: No valid name or requirements file found.
Step #2 - "build_development_docker_image": �[0mok: [localhost]
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [configure_env : Append environment variables required during runtime to ~/.bashrc] ***
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:46:07 +0000 (0:00:00.495)       0:00:22.327 ********* 
Step #2 - "build_development_docker_image": changed: [localhost] => (item=CC)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=CXX)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=LD_LIBRARY_PATH)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=ACCELERATOR)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=TPUVM_MODE)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": TASK [configure_env : Append environment variables required during runtime to ~/.zshrc] ***
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:46:09 +0000 (0:00:01.569)       0:00:23.897 ********* 
Step #2 - "build_development_docker_image": changed: [localhost] => (item=CC)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=CXX)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=LD_LIBRARY_PATH)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=ACCELERATOR)
Step #2 - "build_development_docker_image": changed: [localhost] => (item=TPUVM_MODE)
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": PLAY RECAP *********************************************************************
Step #2 - "build_development_docker_image": localhost                  : ok=12   changed=5    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0   
Step #2 - "build_development_docker_image": 
Step #2 - "build_development_docker_image": Wednesday 01 May 2024  19:46:10 +0000 (0:00:01.469)       0:00:25.367 ********* 
Step #2 - "build_development_docker_image": =============================================================================== 
Step #2 - "build_development_docker_image": install_deps : Install apt packages ------------------------------------- 7.89s
Step #2 - "build_development_docker_image": install_deps : Install pip packages ------------------------------------- 6.25s
Step #2 - "build_development_docker_image": install_deps : Add apt repositories into sources list ------------------- 3.05s
Step #2 - "build_development_docker_image": configure_env : Append environment variables required during runtime to ~/.bashrc --- 1.57s
Step #2 - "build_development_docker_image": install_deps : Add apt keys --------------------------------------------- 1.52s
Step #2 - "build_development_docker_image": configure_env : Append environment variables required during runtime to ~/.zshrc --- 1.47s
Step #2 - "build_development_docker_image": Gathering Facts --------------------------------------------------------- 1.30s
Step #2 - "build_development_docker_image": bazel : Download bazelisk v1.15.0 --------------------------------------- 0.95s
Step #2 - "build_development_docker_image": bazel : Bazel --version runs succesfully -------------------------------- 0.71s
Step #2 - "build_development_docker_image": install_deps : Install pip packages without deps (--no-deps) ------------ 0.50s
Step #2 - "build_development_docker_image": Include vars from config files ------------------------------------------ 0.09s
Step #2 - "build_development_docker_image": bazel : Tests ----------------------------------------------------------- 0.04s
Step #2 - "build_development_docker_image": install_deps : Update apt cache ----------------------------------------- 0.03s
Step #2 - "build_development_docker_image": Removing intermediate container bc8b1f1e2d2e
Step #2 - "build_development_docker_image":  ---> 2ad79a3b50a8
Step #2 - "build_development_docker_image": Successfully built 2ad79a3b50a8
Step #2 - "build_development_docker_image": Successfully tagged us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/development:tpu
Step #2 - "build_development_docker_image": Successfully tagged us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/development:3.10_tpuvm
Step #2 - "build_development_docker_image": Successfully tagged us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/development:3.10_tpuvm_20240501
Step #2 - "build_development_docker_image": Successfully tagged local_image:latest
Finished Step #2 - "build_development_docker_image"
Starting Step #3 - "push_development_docker_image"
Step #3 - "push_development_docker_image": Already have image (with digest): gcr.io/cloud-builders/docker
Step #3 - "push_development_docker_image": The push refers to repository [us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/development]
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Preparing
Step #3 - "push_development_docker_image": 7cdd9bb64019: Preparing
Step #3 - "push_development_docker_image": 8005973ab8f1: Preparing
Step #3 - "push_development_docker_image": eecfb32ba8e0: Preparing
Step #3 - "push_development_docker_image": a105bc96d154: Preparing
Step #3 - "push_development_docker_image": 1e15f07af706: Preparing
Step #3 - "push_development_docker_image": 392f916c39cc: Preparing
Step #3 - "push_development_docker_image": 8aec4a886a70: Preparing
Step #3 - "push_development_docker_image": c4c533a462b4: Preparing
Step #3 - "push_development_docker_image": f50eca7ee9ab: Preparing
Step #3 - "push_development_docker_image": 04a325c21dbd: Preparing
Step #3 - "push_development_docker_image": 9dcbabc40b87: Preparing
Step #3 - "push_development_docker_image": 1e15f07af706: Waiting
Step #3 - "push_development_docker_image": 392f916c39cc: Waiting
Step #3 - "push_development_docker_image": 8aec4a886a70: Waiting
Step #3 - "push_development_docker_image": c4c533a462b4: Waiting
Step #3 - "push_development_docker_image": f50eca7ee9ab: Waiting
Step #3 - "push_development_docker_image": 04a325c21dbd: Waiting
Step #3 - "push_development_docker_image": 9dcbabc40b87: Waiting
Step #3 - "push_development_docker_image": a105bc96d154: Layer already exists
Step #3 - "push_development_docker_image": 1e15f07af706: Layer already exists
Step #3 - "push_development_docker_image": 392f916c39cc: Layer already exists
Step #3 - "push_development_docker_image": 8aec4a886a70: Layer already exists
Step #3 - "push_development_docker_image": c4c533a462b4: Layer already exists
Step #3 - "push_development_docker_image": 8005973ab8f1: Pushed
Step #3 - "push_development_docker_image": f50eca7ee9ab: Layer already exists
Step #3 - "push_development_docker_image": 04a325c21dbd: Layer already exists
Step #3 - "push_development_docker_image": 9dcbabc40b87: Layer already exists
Step #3 - "push_development_docker_image": eecfb32ba8e0: Pushed
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Pushed
Step #3 - "push_development_docker_image": 7cdd9bb64019: Pushed
Step #3 - "push_development_docker_image": 3.10_tpuvm: digest: sha256:2316abc25288cc53a1a8a46c719bb549235562118bcfbbad434941373fa2ea13 size: 2855
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Preparing
Step #3 - "push_development_docker_image": 7cdd9bb64019: Preparing
Step #3 - "push_development_docker_image": 8005973ab8f1: Preparing
Step #3 - "push_development_docker_image": eecfb32ba8e0: Preparing
Step #3 - "push_development_docker_image": a105bc96d154: Preparing
Step #3 - "push_development_docker_image": 1e15f07af706: Preparing
Step #3 - "push_development_docker_image": 392f916c39cc: Preparing
Step #3 - "push_development_docker_image": 8aec4a886a70: Preparing
Step #3 - "push_development_docker_image": c4c533a462b4: Preparing
Step #3 - "push_development_docker_image": f50eca7ee9ab: Preparing
Step #3 - "push_development_docker_image": 04a325c21dbd: Preparing
Step #3 - "push_development_docker_image": 9dcbabc40b87: Preparing
Step #3 - "push_development_docker_image": 1e15f07af706: Waiting
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Layer already exists
Step #3 - "push_development_docker_image": 392f916c39cc: Waiting
Step #3 - "push_development_docker_image": 8aec4a886a70: Waiting
Step #3 - "push_development_docker_image": 7cdd9bb64019: Layer already exists
Step #3 - "push_development_docker_image": c4c533a462b4: Waiting
Step #3 - "push_development_docker_image": 8005973ab8f1: Layer already exists
Step #3 - "push_development_docker_image": f50eca7ee9ab: Waiting
Step #3 - "push_development_docker_image": a105bc96d154: Layer already exists
Step #3 - "push_development_docker_image": 04a325c21dbd: Waiting
Step #3 - "push_development_docker_image": 8aec4a886a70: Layer already exists
Step #3 - "push_development_docker_image": 9dcbabc40b87: Waiting
Step #3 - "push_development_docker_image": c4c533a462b4: Layer already exists
Step #3 - "push_development_docker_image": f50eca7ee9ab: Layer already exists
Step #3 - "push_development_docker_image": 04a325c21dbd: Layer already exists
Step #3 - "push_development_docker_image": 392f916c39cc: Layer already exists
Step #3 - "push_development_docker_image": 1e15f07af706: Layer already exists
Step #3 - "push_development_docker_image": 9dcbabc40b87: Layer already exists
Step #3 - "push_development_docker_image": eecfb32ba8e0: Layer already exists
Step #3 - "push_development_docker_image": 3.10_tpuvm_20240501: digest: sha256:2316abc25288cc53a1a8a46c719bb549235562118bcfbbad434941373fa2ea13 size: 2855
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Preparing
Step #3 - "push_development_docker_image": 7cdd9bb64019: Preparing
Step #3 - "push_development_docker_image": 8005973ab8f1: Preparing
Step #3 - "push_development_docker_image": eecfb32ba8e0: Preparing
Step #3 - "push_development_docker_image": a105bc96d154: Preparing
Step #3 - "push_development_docker_image": 1e15f07af706: Preparing
Step #3 - "push_development_docker_image": 392f916c39cc: Preparing
Step #3 - "push_development_docker_image": 8aec4a886a70: Preparing
Step #3 - "push_development_docker_image": c4c533a462b4: Preparing
Step #3 - "push_development_docker_image": f50eca7ee9ab: Preparing
Step #3 - "push_development_docker_image": 04a325c21dbd: Preparing
Step #3 - "push_development_docker_image": 9dcbabc40b87: Preparing
Step #3 - "push_development_docker_image": 8005973ab8f1: Layer already exists
Step #3 - "push_development_docker_image": a105bc96d154: Layer already exists
Step #3 - "push_development_docker_image": 1e15f07af706: Layer already exists
Step #3 - "push_development_docker_image": f50eca7ee9ab: Waiting
Step #3 - "push_development_docker_image": eecfb32ba8e0: Layer already exists
Step #3 - "push_development_docker_image": 392f916c39cc: Layer already exists
Step #3 - "push_development_docker_image": 04a325c21dbd: Waiting
Step #3 - "push_development_docker_image": 8aec4a886a70: Waiting
Step #3 - "push_development_docker_image": 9dcbabc40b87: Waiting
Step #3 - "push_development_docker_image": c4c533a462b4: Waiting
Step #3 - "push_development_docker_image": c4c533a462b4: Layer already exists
Step #3 - "push_development_docker_image": f50eca7ee9ab: Layer already exists
Step #3 - "push_development_docker_image": 9dcbabc40b87: Layer already exists
Step #3 - "push_development_docker_image": 8aec4a886a70: Layer already exists
Step #3 - "push_development_docker_image": 04a325c21dbd: Layer already exists
Step #3 - "push_development_docker_image": 7cdd9bb64019: Layer already exists
Step #3 - "push_development_docker_image": 9c7e0ed0daa3: Layer already exists
Step #3 - "push_development_docker_image": tpu: digest: sha256:2316abc25288cc53a1a8a46c719bb549235562118bcfbbad434941373fa2ea13 size: 2855
Finished Step #3 - "push_development_docker_image"
PUSH
DONE

Build Log: https://console.cloud.google.com/cloud-build/builds;region=us-central1/3bcf7d19-a6c2-494a-9a54-c66e636a8e2e?project=1001674285173