Update Docker image and add CPU torch installation

[ManfeiBai]

add this command for libtpu.so file to fix INTERNAL: Failed to open libtpu.so: libtpu.so: cannot open shared object file: No such file or directory when using docker image

[JackCaoG]

I don't think we use this script anymore?

[ManfeiBai]

this script is used when build image if we build docker image using https://github.com/pytorch/xla/blob/master/docker/Dockerfile: https://github.com/pytorch/xla/blob/bf47009582d513d4068478f0e0e372657e1cabb8/docker/Dockerfile#L58C37-L58C58

add this func install_libtpu might help INTERNAL: Failed to open libtpu.so: libtpu.so: cannot open shared object file: No such file or directory, will see CI tests results

[JackCaoG]

right, but I thought re don't use that docker now, given our docker build is based on https://github.com/pytorch/xla/tree/master/infra . @will-cromar am I missing something

[will-cromar]

No, this docker file is not used anymore. I don't think we even use it in the TPU CI.

[ManfeiBai]

Thanks, updated to modify in https://github.com/pytorch/xla/tree/master/infra's Dockerfile

[will-cromar]

I'm not sure I understand the context.

Nightly wheels already have libtpu bundled, so they won't need this. Is this problem on the release images? This image tag will have libtpu already installed: us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_libtpu_3.10_tpuvm

[ManfeiBai]

I'm not sure I understand the context.

Nightly wheels already have libtpu bundled, so they won't need this. Is this problem on the release images? This image tag will have libtpu already installed: us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_libtpu_3.10_tpuvm

when i try to use docker image as a user from https://github.com/pytorch/xla#docker, i installed us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_3.10_tpuvm and there is no libtpu installed inside, so wanna add command to install libtpu

thanks for pointing this docker image us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_libtpu_3.10_tpuvm here, do we want to change suggested 2.1 docker image to us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:r2.1.0_libtpu_3.10_tpuvm for TPUVM use case, from my side, user might would need to use libtpu if they use this docker image

[will-cromar]

Yeah, that's my bad. Thanks for catching it. Let's update the documented image to the r2.1.0_libtpu... one

[ManfeiBai]

Yeah, that's my bad. Thanks for catching it. Let's update the documented image to the r2.1.0_libtpu... one

Thanks, udpated

do we want to build a wheel for py38 with libtpu too? now the 2.1 wheel for py38 is https://storage.googleapis.com/pytorch-xla-releases/wheels/tpuvm/torch_xla-2.1.0-cp38-cp38-manylinux_2_28_x86_64.whl