Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add triton dependency, readd cudss and cusparselt, mention dev speedup tricks in the README #309

Merged
merged 14 commits into from
Jan 5, 2025

Conversation

mgorny
Copy link
Contributor

@mgorny mgorny commented Dec 27, 2024

Checklist

  • Used a personal fork of the feedstock to propose changes
  • Bumped the build number (if the version is unchanged)
  • Reset the build number to 0 (if the version changed)
  • Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
  • Ensured the license file is being packaged.

@conda-forge-admin
Copy link
Contributor

conda-forge-admin commented Dec 27, 2024

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

I do have some suggestions for making it better though...

For recipe/meta.yaml:

  • ℹ️ The recipe is not parsable by parser conda-souschef (grayskull). This parser is not currently used by conda-forge, but may be in the future. We are collecting information to see which recipes are compatible with grayskull.
  • ℹ️ The recipe is not parsable by parser conda-recipe-manager. The recipe can only be automatically migrated to the new v1 format if it is parseable by conda-recipe-manager.

This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12601832807. Examine the logs at this URL for more detail.

@h-vetinari h-vetinari self-requested a review as a code owner December 28, 2024 09:24
@h-vetinari
Copy link
Member

Started only a single job for now (x64+CUDA+generic). If this one passes we can run the rest (modulo other changes from review).

@h-vetinari
Copy link
Member

So the CI here for x64+CUDA+generic passed. I think you could push whatever new commits you have @mgorny and we can do a full CI run.

@mgorny
Copy link
Contributor Author

mgorny commented Dec 30, 2024

@mgorny
Copy link
Contributor Author

mgorny commented Dec 30, 2024

Hmm, or maybe protobuf needs to be rebuilt. Though it's still weird that ABI changed on rebuild.

@h-vetinari
Copy link
Member

h-vetinari commented Dec 30, 2024

Hmm, or maybe protobuf needs to be rebuilt. Though it's still weird that ABI changed on rebuild.

It's something to do with clang 17 to clang 18. I've looked at the breaking changes at the time, and nothing stood out in particular. I guess abseil does unusual things, relatively speaking... In any case, I'm hoping that once we've rebuilt the core protobuf stack (conda-forge/libprotobuf-feedstock#244 + maybe one for grpc), the issue will resolve itself... (edit: or maybe not: arrow also seems to fail)

@mgorny
Copy link
Contributor Author

mgorny commented Dec 30, 2024

Could you trigger the Linux CI builds, please?

@h-vetinari
Copy link
Member

Could you trigger the Linux CI builds, please?

Was waiting for the libprotobuf builds to make it through the CDN. That's happened just now.

@h-vetinari
Copy link
Member

I'm leaving the linux CI running for now; to fix OSX, we should pick up the changes from #310 here.

@mgorny
Copy link
Contributor Author

mgorny commented Jan 1, 2025

Hmm, looks like two jobs failed with "This request was automatically failed because there were no enabled runners online to process". The other four passed.

@hmaarrfk
Copy link
Contributor

hmaarrfk commented Jan 1, 2025

i clicked rerun failed jobs. that is my contribution ^_^

@mgorny
Copy link
Contributor Author

mgorny commented Jan 2, 2025

Oh, right, we don't build Triton for aarch64 (yet). Let's see if that is possible…

@mgorny
Copy link
Contributor Author

mgorny commented Jan 3, 2025

Ok, so the current status is:

@mgorny
Copy link
Contributor Author

mgorny commented Jan 3, 2025

Okay, I'm going to wait for new triton builds to propagate, then merge main and #310 here to trigger new CI.

@mgorny
Copy link
Contributor Author

mgorny commented Jan 3, 2025

@h-vetinari, I think we can limit CI to the aarch64 + CUDA job. There were no other changes, and everything else passed the previous time.

@mgorny
Copy link
Contributor Author

mgorny commented Jan 4, 2025

Sigh, I hope that the failing build was a runner GPU problem and not something with the package.

@fxcoudert
Copy link

It failed at ~55% of the test through, with:

2025-01-04T03:01:04.0396597Z ##[error]Process completed with exit code 137.
2025-01-04T03:01:04.1032050Z Post job cleanup.
2025-01-04T03:01:04.2806960Z ##[error]The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
2025-01-04T03:01:04.3642148Z ##[error]The operation was canceled.

detailed logs follow:

2025-01-04T02:44:00.3944517Z TEST START: /home/conda/feedstock_root/build_artifacts/linux-64/pytorch-2.5.1-cuda126_generic_py313_h719a2e2_208.conda
2025-01-04T02:44:02.9663734Z WARNING: Multiple meta files found. The meta.yaml file in the base directory (/tmp/tmpbok04mav/info/recipe) will be used.
2025-01-04T02:44:02.9743618Z Adding in variants from /tmp/tmpbok04mav/info/recipe/conda_build_config.yaml
2025-01-04T02:44:09.7895597Z Reloading output folder: ...working... done
2025-01-04T02:44:12.5729835Z Solving environment (_test_env): ...working... done
2025-01-04T02:44:12.6294102Z 
2025-01-04T02:44:12.6294568Z ## Package Plan ##
2025-01-04T02:44:12.6294914Z 
2025-01-04T02:44:12.6297461Z   environment location: /home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho
2025-01-04T02:44:12.6300266Z 
2025-01-04T02:44:12.6306651Z 
2025-01-04T02:44:12.6307432Z The following NEW packages will be INSTALLED:
2025-01-04T02:44:12.6308426Z 
2025-01-04T02:44:12.6308879Z     _libgcc_mutex:               0.1-conda_forge                          conda-forge
2025-01-04T02:44:12.6309975Z     _openmp_mutex:               4.5-2_gnu                                conda-forge
2025-01-04T02:44:12.6311137Z     atk-1.0:                     2.38.0-h04ea711_2                        conda-forge
2025-01-04T02:44:12.6312092Z     attr:                        2.5.1-h166bdaf_1                         conda-forge
2025-01-04T02:44:12.6313058Z     attrs:                       24.3.0-pyh71513ae_0                      conda-forge
2025-01-04T02:44:12.6314162Z     binutils_impl_linux-64:      2.43-h4bf12b8_2                          conda-forge
2025-01-04T02:44:12.6315352Z     binutils_linux-64:           2.43-h4852527_2                          conda-forge
2025-01-04T02:44:12.6317528Z     boto3:                       1.35.92-pyhd8ed1ab_0                     conda-forge
2025-01-04T02:44:12.6318686Z     botocore:                    1.35.92-pyge310_1234567_0                conda-forge
2025-01-04T02:44:12.6319765Z     brotli-python:               1.1.0-py313h46c70d0_2                    conda-forge
2025-01-04T02:44:12.6321168Z     bzip2:                       1.0.8-h4bc722e_7                         conda-forge
2025-01-04T02:44:12.6322577Z     ca-certificates:             2024.12.14-hbcca054_0                    conda-forge
2025-01-04T02:44:12.6323812Z     cairo:                       1.18.2-h3394656_1                        conda-forge
2025-01-04T02:44:12.6324932Z     cffi:                        1.17.1-py313hfab6e84_0                   conda-forge
2025-01-04T02:44:12.6325900Z     click:                       8.1.8-pyh707e725_0                       conda-forge
2025-01-04T02:44:12.6326913Z     colorama:                    0.4.6-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6327930Z     cpython:                     3.13.1-py313hd8ed1ab_102                 conda-forge
2025-01-04T02:44:12.6329364Z     cuda-cccl_linux-64:          12.6.77-ha770c72_0                       conda-forge
2025-01-04T02:44:12.6330522Z     cuda-crt-dev_linux-64:       12.6.85-ha770c72_0                       conda-forge
2025-01-04T02:44:12.6331985Z     cuda-crt-tools:              12.6.85-ha770c72_0                       conda-forge
2025-01-04T02:44:12.6333053Z     cuda-cudart:                 12.6.77-h5888daf_0                       conda-forge
2025-01-04T02:44:12.6334522Z     cuda-cudart-dev:             12.6.77-h5888daf_0                       conda-forge
2025-01-04T02:44:12.6335905Z     cuda-cudart-dev_linux-64:    12.6.77-h3f2d84a_0                       conda-forge
2025-01-04T02:44:12.6337261Z     cuda-cudart-static:          12.6.77-h5888daf_0                       conda-forge
2025-01-04T02:44:12.6338489Z     cuda-cudart-static_linux-64: 12.6.77-h3f2d84a_0                       conda-forge
2025-01-04T02:44:12.6341415Z     cuda-cudart_linux-64:        12.6.77-h3f2d84a_0                       conda-forge
2025-01-04T02:44:12.6344950Z     cuda-cuobjdump:              12.6.77-hbd13f7d_1                       conda-forge
2025-01-04T02:44:12.6351135Z     cuda-cupti:                  12.6.80-hbd13f7d_0                       conda-forge
2025-01-04T02:44:12.6352339Z     cuda-driver-dev_linux-64:    12.6.77-h3f2d84a_0                       conda-forge
2025-01-04T02:44:12.6354539Z     cuda-nvcc:                   12.6.85-hcdd1206_0                       conda-forge
2025-01-04T02:44:12.6355682Z     cuda-nvcc-dev_linux-64:      12.6.85-he91c749_0                       conda-forge
2025-01-04T02:44:12.6357345Z     cuda-nvcc-impl:              12.6.85-h85509e4_0                       conda-forge
2025-01-04T02:44:12.6362107Z     cuda-nvcc-tools:             12.6.85-he02047a_0                       conda-forge
2025-01-04T02:44:12.6363881Z     cuda-nvcc_linux-64:          12.6.85-h04802cd_0                       conda-forge
2025-01-04T02:44:12.6365592Z     cuda-nvdisasm:               12.6.77-hbd13f7d_1                       conda-forge
2025-01-04T02:44:12.6367399Z     cuda-nvrtc:                  12.6.85-hbd13f7d_0                       conda-forge
2025-01-04T02:44:12.6368434Z     cuda-nvtx:                   12.6.77-hbd13f7d_0                       conda-forge
2025-01-04T02:44:12.6369524Z     cuda-nvvm-dev_linux-64:      12.6.85-ha770c72_0                       conda-forge
2025-01-04T02:44:12.6370862Z     cuda-nvvm-impl:              12.6.85-he02047a_0                       conda-forge
2025-01-04T02:44:12.6372655Z     cuda-nvvm-tools:             12.6.85-he02047a_0                       conda-forge
2025-01-04T02:44:12.6373765Z     cuda-version:                12.6-h7480c83_3                          conda-forge
2025-01-04T02:44:12.6375267Z     cudnn:                       9.3.0.75-h62a6f1c_2                      conda-forge
2025-01-04T02:44:12.6376521Z     cusparselt:                  0.6.3.2-hdea8103_1                       conda-forge
2025-01-04T02:44:12.6380614Z     exceptiongroup:              1.2.2-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6384974Z     execnet:                     2.1.1-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6390655Z     expecttest:                  0.3.0-pyhd8ed1ab_0                       conda-forge
2025-01-04T02:44:12.6391740Z     filelock:                    3.16.1-pyhd8ed1ab_1                      conda-forge
2025-01-04T02:44:12.6392943Z     font-ttf-dejavu-sans-mono:   2.37-hab24e00_0                          conda-forge
2025-01-04T02:44:12.6395884Z     font-ttf-inconsolata:        3.000-h77eed37_0                         conda-forge
2025-01-04T02:44:12.6398193Z     font-ttf-source-code-pro:    2.038-h77eed37_0                         conda-forge
2025-01-04T02:44:12.6399937Z     font-ttf-ubuntu:             0.83-h77eed37_3                          conda-forge
2025-01-04T02:44:12.6401425Z     fontconfig:                  2.15.0-h7e30c49_1                        conda-forge
2025-01-04T02:44:12.6403930Z     fonts-conda-ecosystem:       1-0                                      conda-forge
2025-01-04T02:44:12.6405493Z     fonts-conda-forge:           1-0                                      conda-forge
2025-01-04T02:44:12.6406808Z     freetype:                    2.12.1-h267a509_2                        conda-forge
2025-01-04T02:44:12.6408503Z     fribidi:                     1.0.10-h36c2ea0_0                        conda-forge
2025-01-04T02:44:12.6409913Z     fsspec:                      2024.12.0-pyhd8ed1ab_0                   conda-forge
2025-01-04T02:44:12.6411605Z     gcc_impl_linux-64:           13.3.0-hfea6d02_1                        conda-forge
2025-01-04T02:44:12.6415152Z     gcc_linux-64:                13.3.0-hc28eda2_7                        conda-forge
2025-01-04T02:44:12.6422095Z     gdk-pixbuf:                  2.42.12-hb9ae30d_0                       conda-forge
2025-01-04T02:44:12.6426685Z     gmp:                         6.3.0-hac33072_2                         conda-forge
2025-01-04T02:44:12.6432228Z     gmpy2:                       2.1.5-py313h11186cd_3                    conda-forge
2025-01-04T02:44:12.6435162Z     graphite2:                   1.3.13-h59595ed_1003                     conda-forge
2025-01-04T02:44:12.6436195Z     graphviz:                    12.0.0-hba01fac_0                        conda-forge
2025-01-04T02:44:12.6437591Z     gtk2:                        2.24.33-h8ee276e_7                       conda-forge
2025-01-04T02:44:12.6438797Z     gts:                         0.7.6-h977cf35_4                         conda-forge
2025-01-04T02:44:12.6440013Z     gxx_impl_linux-64:           13.3.0-hdbfa832_1                        conda-forge
2025-01-04T02:44:12.6442833Z     gxx_linux-64:                13.3.0-h6834431_7                        conda-forge
2025-01-04T02:44:12.6444509Z     h2:                          4.1.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6448720Z     harfbuzz:                    10.1.0-h0b3b770_0                        conda-forge
2025-01-04T02:44:12.6452775Z     hpack:                       4.0.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6457611Z     hyperframe:                  6.0.1-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6459612Z     hypothesis:                  6.123.2-pyha770c72_0                     conda-forge
2025-01-04T02:44:12.6463023Z     icu:                         75.1-he02047a_0                          conda-forge
2025-01-04T02:44:12.6464517Z     iniconfig:                   2.0.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6468757Z     jinja2:                      3.1.5-pyhd8ed1ab_0                       conda-forge
2025-01-04T02:44:12.6470814Z     jmespath:                    1.0.1-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6472557Z     kernel-headers_linux-64:     3.10.0-he073ed8_18                       conda-forge
2025-01-04T02:44:12.6473754Z     ld_impl_linux-64:            2.43-h712a8e2_2                          conda-forge
2025-01-04T02:44:12.6474793Z     lerc:                        4.0.0-h27087fc_0                         conda-forge
2025-01-04T02:44:12.6475827Z     libabseil:                   20240722.0-cxx17_hbbce691_2              conda-forge
2025-01-04T02:44:12.6476869Z     libblas:                     3.9.0-26_linux64_openblas                conda-forge
2025-01-04T02:44:12.6477891Z     libcap:                      2.71-h39aace5_0                          conda-forge
2025-01-04T02:44:12.6478913Z     libcblas:                    3.9.0-26_linux64_openblas                conda-forge
2025-01-04T02:44:12.6479942Z     libcublas:                   12.6.4.1-hbd13f7d_0                      conda-forge
2025-01-04T02:44:12.6480983Z     libcudss0:                   0.4.0.2-he55f5cd_2                       conda-forge
2025-01-04T02:44:12.6482226Z     libcufft:                    11.3.0.4-hbd13f7d_0                      conda-forge
2025-01-04T02:44:12.6483243Z     libcufile:                   1.11.1.6-h12f29b5_4                      conda-forge
2025-01-04T02:44:12.6484291Z     libcurand:                   10.3.7.77-hbd13f7d_0                     conda-forge
2025-01-04T02:44:12.6485397Z     libcusolver:                 11.7.1.2-hbd13f7d_0                      conda-forge
2025-01-04T02:44:12.6486466Z     libcusparse:                 12.5.4.2-hbd13f7d_0                      conda-forge
2025-01-04T02:44:12.6487558Z     libdeflate:                  1.23-h4ddbbb0_0                          conda-forge
2025-01-04T02:44:12.6488613Z     libexpat:                    2.6.4-h5888daf_0                         conda-forge
2025-01-04T02:44:12.6489613Z     libffi:                      3.4.2-h7f98852_5                         conda-forge
2025-01-04T02:44:12.6490584Z     libgcc:                      14.2.0-h77fa898_1                        conda-forge
2025-01-04T02:44:12.6491680Z     libgcc-devel_linux-64:       13.3.0-h84ea5a7_101                      conda-forge
2025-01-04T02:44:12.6492789Z     libgcc-ng:                   14.2.0-h69a702a_1                        conda-forge
2025-01-04T02:44:12.6494179Z     libgcrypt-lib:               1.11.0-hb9d3cd8_2                        conda-forge
2025-01-04T02:44:12.6495234Z     libgd:                       2.3.3-hd3e95f3_10                        conda-forge
2025-01-04T02:44:12.6496269Z     libgfortran:                 14.2.0-h69a702a_1                        conda-forge
2025-01-04T02:44:12.6497458Z     libgfortran5:                14.2.0-hd5240d6_1                        conda-forge
2025-01-04T02:44:12.6498519Z     libglib:                     2.82.2-h2ff4ddf_0                        conda-forge
2025-01-04T02:44:12.6499525Z     libgomp:                     14.2.0-h77fa898_1                        conda-forge
2025-01-04T02:44:12.6500571Z     libgpg-error:                1.51-hbd13f7d_1                          conda-forge
2025-01-04T02:44:12.6501643Z     libiconv:                    1.17-hd590300_2                          conda-forge
2025-01-04T02:44:12.6502719Z     libjpeg-turbo:               3.0.0-hd590300_1                         conda-forge
2025-01-04T02:44:12.6503818Z     liblapack:                   3.9.0-26_linux64_openblas                conda-forge
2025-01-04T02:44:12.6505011Z     libllvm19:                   19.1.6-ha7bfdaf_0                        conda-forge
2025-01-04T02:44:12.6506044Z     liblzma:                     5.6.3-hb9d3cd8_1                         conda-forge
2025-01-04T02:44:12.6507149Z     libmagma:                    2.8.0-h566cb83_2                         conda-forge
2025-01-04T02:44:12.6508171Z     libmpdec:                    4.0.0-h4bc722e_0                         conda-forge
2025-01-04T02:44:12.6509168Z     libnl:                       3.11.0-hb9d3cd8_0                        conda-forge
2025-01-04T02:44:12.6510218Z     libnvjitlink:                12.6.85-hbd13f7d_0                       conda-forge
2025-01-04T02:44:12.6511323Z     libopenblas:                 0.3.28-pthreads_h94d23a6_1               conda-forge
2025-01-04T02:44:12.6512379Z     libpng:                      1.6.44-hadc24fc_0                        conda-forge
2025-01-04T02:44:12.6513424Z     libprotobuf:                 5.28.3-h6128344_1                        conda-forge
2025-01-04T02:44:12.6514478Z     librsvg:                     2.58.4-h49af25d_2                        conda-forge
2025-01-04T02:44:12.6515568Z     libsanitizer:                13.3.0-heb74ff8_1                        conda-forge
2025-01-04T02:44:12.6516661Z     libsqlite:                   3.47.2-hee588c1_0                        conda-forge
2025-01-04T02:44:12.6517708Z     libstdcxx:                   14.2.0-hc0a3c3a_1                        conda-forge
2025-01-04T02:44:12.6518857Z     libstdcxx-devel_linux-64:    13.3.0-h84ea5a7_101                      conda-forge
2025-01-04T02:44:12.6520023Z     libstdcxx-ng:                14.2.0-h4852527_1                        conda-forge
2025-01-04T02:44:12.6521115Z     libsystemd0:                 256.9-h0b6a36f_2                         conda-forge
2025-01-04T02:44:12.6522350Z     libtiff:                     4.7.0-hd9ff511_3                         conda-forge
2025-01-04T02:44:12.6523391Z     libtorch:                    2.5.1-cuda126_generic_hb23410f_208       local      
2025-01-04T02:44:12.6524445Z     libudev1:                    256.9-h9a4d06a_2                         conda-forge
2025-01-04T02:44:12.6525454Z     libuuid:                     2.38.1-h0b41bf4_0                        conda-forge
2025-01-04T02:44:12.6526447Z     libuv:                       1.49.2-hb9d3cd8_0                        conda-forge
2025-01-04T02:44:12.6527487Z     libwebp-base:                1.5.0-h851e524_0                         conda-forge
2025-01-04T02:44:12.6528518Z     libxcb:                      1.17.0-h8a09558_0                        conda-forge
2025-01-04T02:44:12.6529494Z     libxml2:                     2.13.5-h8d12d68_1                        conda-forge
2025-01-04T02:44:12.6530497Z     libzlib:                     1.3.1-hb9d3cd8_2                         conda-forge
2025-01-04T02:44:12.6531590Z     lz4-c:                       1.10.0-h5888daf_1                        conda-forge
2025-01-04T02:44:12.6532602Z     markupsafe:                  3.0.2-py313h8060acc_1                    conda-forge
2025-01-04T02:44:12.6533619Z     mpc:                         1.3.1-h24ddda3_1                         conda-forge
2025-01-04T02:44:12.6534673Z     mpfr:                        4.2.1-h90cbb55_3                         conda-forge
2025-01-04T02:44:12.6535744Z     mpmath:                      1.3.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6536781Z     nccl:                        2.23.4.1-h2b5d15b_3                      conda-forge
2025-01-04T02:44:12.6537767Z     ncurses:                     6.5-he02047a_1                           conda-forge
2025-01-04T02:44:12.6538798Z     networkx:                    3.4.2-pyh267e887_2                       conda-forge
2025-01-04T02:44:12.6539791Z     ninja:                       1.12.1-h297d8ca_0                        conda-forge
2025-01-04T02:44:12.6540778Z     nomkl:                       1.0-h5ca1d4c_0                           conda-forge
2025-01-04T02:44:12.6541860Z     numpy:                       2.2.1-py313hb30382a_0                    conda-forge
2025-01-04T02:44:12.6542852Z     openssl:                     3.4.0-hb9d3cd8_0                         conda-forge
2025-01-04T02:44:12.6543995Z     packaging:                   24.2-pyhd8ed1ab_2                        conda-forge
2025-01-04T02:44:12.6545039Z     pango:                       1.54.0-h861ebed_4                        conda-forge
2025-01-04T02:44:12.6546025Z     pcre2:                       10.44-hba22ea6_2                         conda-forge
2025-01-04T02:44:12.6546983Z     pip:                         24.3.1-pyh145f28c_2                      conda-forge
2025-01-04T02:44:12.6547955Z     pixman:                      0.44.2-h29eaf8c_0                        conda-forge
2025-01-04T02:44:12.6548955Z     pluggy:                      1.5.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6550024Z     pthread-stubs:               0.4-hb9d3cd8_1002                        conda-forge
2025-01-04T02:44:12.6551133Z     pycparser:                   2.22-pyh29332c3_1                        conda-forge
2025-01-04T02:44:12.6552163Z     pydot:                       3.0.3-py313h78bf25f_0                    conda-forge
2025-01-04T02:44:12.6553198Z     pyparsing:                   3.2.1-pyhd8ed1ab_0                       conda-forge
2025-01-04T02:44:12.6554254Z     pysocks:                     1.7.1-pyha55dd90_7                       conda-forge
2025-01-04T02:44:12.6555276Z     pytest:                      8.3.4-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6556403Z     pytest-flakefinder:          1.1.0-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6557689Z     pytest-rerunfailures:        15.0-pyhd8ed1ab_1                        conda-forge
2025-01-04T02:44:12.6558901Z     pytest-xdist:                3.6.1-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6559967Z     python:                      3.13.1-ha99a958_102_cp313                conda-forge
2025-01-04T02:44:12.6561068Z     python-dateutil:             2.9.0.post0-pyhff2d567_1                 conda-forge
2025-01-04T02:44:12.6562420Z     python_abi:                  3.13-5_cp313                             conda-forge
2025-01-04T02:44:12.6563466Z     pytorch:                     2.5.1-cuda126_generic_py313_h719a2e2_208 local      
2025-01-04T02:44:12.6564510Z     rdma-core:                   55.0-h5888daf_0                          conda-forge
2025-01-04T02:44:12.6565549Z     readline:                    8.2-h8228510_1                           conda-forge
2025-01-04T02:44:12.6566615Z     s3transfer:                  0.10.4-pyhd8ed1ab_1                      conda-forge
2025-01-04T02:44:12.6567691Z     setuptools:                  75.6.0-pyhff2d567_1                      conda-forge
2025-01-04T02:44:12.6568705Z     six:                         1.17.0-pyhd8ed1ab_0                      conda-forge
2025-01-04T02:44:12.6569787Z     sleef:                       3.7-h1b44611_2                           conda-forge
2025-01-04T02:44:12.6570880Z     sortedcontainers:            2.4.0-pyhd8ed1ab_0                       conda-forge
2025-01-04T02:44:12.6571975Z     sympy:                       1.13.3-pyh2585a3b_104                    conda-forge
2025-01-04T02:44:12.6573134Z     sysroot_linux-64:            2.17-h0157908_18                         conda-forge
2025-01-04T02:44:12.6574344Z     tabulate:                    0.9.0-pyhd8ed1ab_2                       conda-forge
2025-01-04T02:44:12.6575316Z     tk:                          8.6.13-noxft_h4845f30_101                conda-forge
2025-01-04T02:44:12.6576268Z     tomli:                       2.2.1-pyhd8ed1ab_1                       conda-forge
2025-01-04T02:44:12.6577283Z     triton:                      3.1.0-cuda126py313h4a10a2e_4             conda-forge
2025-01-04T02:44:12.6578381Z     typing_extensions:           4.12.2-pyha770c72_1                      conda-forge
2025-01-04T02:44:12.6579483Z     tzdata:                      2024b-hc8b5060_0                         conda-forge
2025-01-04T02:44:12.6580604Z     urllib3:                     2.3.0-pyhd8ed1ab_0                       conda-forge
2025-01-04T02:44:12.6581618Z     xmlrunner:                   1.7.7-py_0                               conda-forge
2025-01-04T02:44:12.6582758Z     xorg-libice:                 1.1.2-hb9d3cd8_0                         conda-forge
2025-01-04T02:44:12.6583835Z     xorg-libsm:                  1.2.5-he73a12e_0                         conda-forge
2025-01-04T02:44:12.6584899Z     xorg-libx11:                 1.8.10-h4f16b4b_1                        conda-forge
2025-01-04T02:44:12.6585958Z     xorg-libxau:                 1.0.12-hb9d3cd8_0                        conda-forge
2025-01-04T02:44:12.6587058Z     xorg-libxdmcp:               1.1.5-hb9d3cd8_0                         conda-forge
2025-01-04T02:44:12.6588168Z     xorg-libxext:                1.3.6-hb9d3cd8_0                         conda-forge
2025-01-04T02:44:12.6589293Z     xorg-libxrender:             0.9.12-hb9d3cd8_0                        conda-forge
2025-01-04T02:44:12.6590411Z     zstandard:                   0.23.0-py313h80202fe_1                   conda-forge
2025-01-04T02:44:12.6591416Z     zstd:                        1.5.6-ha6fb4c9_0                         conda-forge
2025-01-04T02:44:12.6592031Z 
2025-01-04T02:44:25.9461187Z Preparing transaction: ...working... done
2025-01-04T02:44:32.3944617Z Verifying transaction: ...working... done
2025-01-04T02:44:35.4608945Z Executing transaction: ...working... By downloading and using the cuSPARSELt conda package, you accept the terms
2025-01-04T02:44:35.4610539Z and conditions of the NVIDIA cuSPARSELt Software License Agreement:
2025-01-04T02:44:35.4611623Z https://docs.nvidia.com/cuda/cusparselt/license.html
2025-01-04T02:44:35.4612227Z 
2025-01-04T02:44:36.8879510Z By downloading and using the cuDNN conda packages, you accept the terms and conditions of the NVIDIA cuDNN EULA -
2025-01-04T02:44:36.8881132Z   https://docs.nvidia.com/deeplearning/cudnn/sla/index.html
2025-01-04T02:44:36.8882045Z 
2025-01-04T02:44:38.3847506Z 
2025-01-04T02:44:39.8700499Z 
2025-01-04T02:44:53.2351200Z done
2025-01-04T02:44:53.3026044Z export PREFIX=/home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho
2025-01-04T02:44:53.3029426Z export SRC_DIR=/home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/test_tmp
2025-01-04T02:44:54.3822057Z INFO: activate-binutils_linux-64.sh made the following environmental changes:
2025-01-04T02:44:54.3859862Z +ADDR2LINE=$PREFIX/bin/x86_64-conda-linux-gnu-addr2line
2025-01-04T02:44:54.3860794Z +AR=$PREFIX/bin/x86_64-conda-linux-gnu-ar
2025-01-04T02:44:54.3861522Z +AS=$PREFIX/bin/x86_64-conda-linux-gnu-as
2025-01-04T02:44:54.3862807Z +CXXFILT=$PREFIX/bin/x86_64-conda-linux-gnu-c++filt
2025-01-04T02:44:54.3863633Z +DWP=$PREFIX/bin/x86_64-conda-linux-gnu-dwp
2025-01-04T02:44:54.3864431Z +ELFEDIT=$PREFIX/bin/x86_64-conda-linux-gnu-elfedit
2025-01-04T02:44:54.3865280Z +GPROF=$PREFIX/bin/x86_64-conda-linux-gnu-gprof
2025-01-04T02:44:54.3866108Z +LD_GOLD=$PREFIX/bin/x86_64-conda-linux-gnu-ld.gold
2025-01-04T02:44:54.3866885Z +LD=$PREFIX/bin/x86_64-conda-linux-gnu-ld
2025-01-04T02:44:54.3867745Z +NM=$PREFIX/bin/x86_64-conda-linux-gnu-nm
2025-01-04T02:44:54.3868529Z +OBJCOPY=$PREFIX/bin/x86_64-conda-linux-gnu-objcopy
2025-01-04T02:44:54.3869373Z +OBJDUMP=$PREFIX/bin/x86_64-conda-linux-gnu-objdump
2025-01-04T02:44:54.3870217Z +RANLIB=$PREFIX/bin/x86_64-conda-linux-gnu-ranlib
2025-01-04T02:44:54.3871067Z +READELF=$PREFIX/bin/x86_64-conda-linux-gnu-readelf
2025-01-04T02:44:54.3871879Z +SIZE=$PREFIX/bin/x86_64-conda-linux-gnu-size
2025-01-04T02:44:54.3872698Z +STRINGS=$PREFIX/bin/x86_64-conda-linux-gnu-strings
2025-01-04T02:44:54.3873545Z +STRIP=$PREFIX/bin/x86_64-conda-linux-gnu-strip
2025-01-04T02:44:54.7238924Z INFO: activate-gcc_linux-64.sh made the following environmental changes:
2025-01-04T02:44:54.7277225Z +build_alias=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7277984Z -BUILD=x86_64-conda_cos6-linux-gnu
2025-01-04T02:44:54.7278659Z +BUILD=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7279371Z +CC_FOR_BUILD=$PREFIX/bin/x86_64-conda-linux-gnu-cc
2025-01-04T02:44:54.7280445Z +CC=$PREFIX/bin/x86_64-conda-linux-gnu-cc
2025-01-04T02:44:54.7283535Z +CFLAGS=-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem $PREFIX/include -fdebug-prefix-map=$SRC_DIR=/usr/local/src/conda/pytorch-2.5.1 -fdebug-prefix-map=$PREFIX=/usr/local/src/conda-prefix
2025-01-04T02:44:54.7294907Z +CMAKE_ARGS=-DCMAKE_AR=$PREFIX/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=$PREFIX/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=$PREFIX/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=$PREFIX/bin/x86_64-conda-linux-gnu-strip -DCMAKE_BUILD_TYPE=Release -DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=NEVER -DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY -DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=ONLY -DCMAKE_FIND_ROOT_PATH=$PREFIX;/home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/_build_env/x86_64-conda-linux-gnu/sysroot -DCMAKE_INSTALL_PREFIX=$PREFIX -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_PROGRAM_PATH=/home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/_build_env/bin;$PREFIX/bin
2025-01-04T02:44:54.7304244Z +CMAKE_PREFIX_PATH=$PREFIX:$PREFIX/x86_64-conda-linux-gnu/sysroot/usr
2025-01-04T02:44:54.7305331Z +CONDA_BUILD_SYSROOT=$PREFIX/x86_64-conda-linux-gnu/sysroot
2025-01-04T02:44:54.7306489Z +_CONDA_PYTHON_SYSCONFIGDATA_NAME=_sysconfigdata_x86_64_conda_cos6_linux_gnu
2025-01-04T02:44:54.7307543Z +CONDA_TOOLCHAIN_BUILD=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7308314Z +CONDA_TOOLCHAIN_HOST=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7309266Z +CPPFLAGS=-DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem $PREFIX/include
2025-01-04T02:44:54.7310226Z +CPP=$PREFIX/bin/x86_64-conda-linux-gnu-cpp
2025-01-04T02:44:54.7313473Z +DEBUG_CFLAGS=-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem $PREFIX/include -fdebug-prefix-map=$SRC_DIR=/usr/local/src/conda/pytorch-2.5.1 -fdebug-prefix-map=$PREFIX=/usr/local/src/conda-prefix
2025-01-04T02:44:54.7316938Z +DEBUG_CPPFLAGS=-D_DEBUG -D_FORTIFY_SOURCE=2 -Og -isystem $PREFIX/include
2025-01-04T02:44:54.7317982Z +GCC_AR=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ar
2025-01-04T02:44:54.7318764Z +GCC=$PREFIX/bin/x86_64-conda-linux-gnu-gcc
2025-01-04T02:44:54.7319548Z +GCC_NM=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-nm
2025-01-04T02:44:54.7320606Z +GCC_RANLIB=$PREFIX/bin/x86_64-conda-linux-gnu-gcc-ranlib
2025-01-04T02:44:54.7321420Z +host_alias=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7322249Z +HOST=x86_64-conda-linux-gnu
2025-01-04T02:44:54.7324164Z +LDFLAGS=-Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined -Wl,-rpath,$PREFIX/lib -Wl,-rpath-link,$PREFIX/lib -L$PREFIX/lib
2025-01-04T02:44:54.7326448Z +MESON_ARGS=-Dbuildtype=release --prefix=$PREFIX -Dlibdir=lib
2025-01-04T02:44:54.8218824Z INFO: activate-gxx_linux-64.sh made the following environmental changes:
2025-01-04T02:44:54.8256585Z +CXXFLAGS=-fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem $PREFIX/include -fdebug-prefix-map=$SRC_DIR=/usr/local/src/conda/pytorch-2.5.1 -fdebug-prefix-map=$PREFIX=/usr/local/src/conda-prefix
2025-01-04T02:44:54.8260228Z +CXX_FOR_BUILD=$PREFIX/bin/x86_64-conda-linux-gnu-c++
2025-01-04T02:44:54.8261076Z +CXX=$PREFIX/bin/x86_64-conda-linux-gnu-c++
2025-01-04T02:44:54.8265156Z +DEBUG_CXXFLAGS=-fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem $PREFIX/include -fdebug-prefix-map=$SRC_DIR=/usr/local/src/conda/pytorch-2.5.1 -fdebug-prefix-map=$PREFIX=/usr/local/src/conda-prefix
2025-01-04T02:44:54.8268943Z +GXX=$PREFIX/bin/x86_64-conda-linux-gnu-g++
2025-01-04T02:44:54.8543427Z import: 'torch'
2025-01-04T02:44:56.3508538Z import: 'torch'
2025-01-04T02:44:56.6596615Z + pip check
2025-01-04T02:44:57.0290956Z No broken requirements found.
2025-01-04T02:44:57.0670905Z + python -c 'import torch; print(torch.__version__)'
2025-01-04T02:44:58.3356070Z 2.5.1.post208
2025-01-04T02:44:58.6319057Z + python -c 'import torch; torch.tensor(1).to('\''cpu'\'').numpy(); print('\''numpy support enabled!!!'\'')'
2025-01-04T02:44:59.9091297Z numpy support enabled!!!
2025-01-04T02:45:00.1944899Z + test -f /home/conda/feedstock_root/build_artifacts/libtorch_1735927386884/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/libtorch_python.so
2025-01-04T02:45:00.1948056Z + export OMP_NUM_THREADS=4
2025-01-04T02:45:00.1948642Z + OMP_NUM_THREADS=4
2025-01-04T02:45:00.1953281Z + python -m pytest -n auto test/test_autograd.py test/test_autograd_fallback.py test/test_custom_ops.py test/test_linalg.py test/test_mkldnn.py test/test_modules.py test/test_nn.py test/test_torch.py test/test_xnnpack_integration.py -m 'not hypothesis' -k 'not ((TestTorch and test_print) or (TestCustomOp and test_data_dependent_compile) or (TestCustomOp and test_functionalize_error) or (TestCustomOpAPI and test_compile) or (TestCustomOpAPI and test_fake) or test_compile_int4_mm or test_compile_int8_mm)' --durations=50
2025-01-04T02:45:00.4981918Z ============================= test session starts ==============================
2025-01-04T02:45:00.4983911Z platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0
2025-01-04T02:45:00.5105480Z rootdir: $SRC_DIR
2025-01-04T02:45:00.5106409Z plugins: hypothesis-6.123.2, rerunfailures-15.0, flakefinder-1.1.0, xdist-3.6.1
2025-01-04T02:45:00.5107428Z created: 8/8 workers
2025-01-04T02:45:13.4931043Z 8 workers [15846 items]
2025-01-04T02:45:13.4931464Z 
2025-01-04T02:45:13.6362118Z .....s..s.s.....s....s...ss..s.s..s....ss.s..ss...s.ss.sss.s.s...ss....s [  0%]
2025-01-04T02:45:13.7248511Z ..s.s...s..s.s.s.s.s.s..s.s..........s..s..s..s..s..ss...ss...s.s..s.s.s [  0%]
2025-01-04T02:45:13.8227318Z .s.s.s.s..s.s.s.s.s..s..s....s.....s..s.s.s.s.ss.s..ssss.sss..ssssss..s. [  1%]
2025-01-04T02:45:13.9894906Z ssssss.ssssssss.s.ssssss.ssssssssssssss.s.ssssss.sssssssssssss.s.sss.s.s [  1%]
2025-01-04T02:45:14.3617744Z ss.ssss.s...s.s.ssssssss.sssssssssssssssssss.ssss.sssssssssss.sssssssss. [  2%]
2025-01-04T02:45:14.8646564Z sssss..sssssssss.s..sssssssssssss....................................... [  2%]
2025-01-04T02:45:15.5409342Z ........................................................................ [  3%]
2025-01-04T02:45:16.7137549Z .........................................ssss.......s................... [  3%]
2025-01-04T02:45:17.6652416Z ..................................................................ssss.. [  4%]
2025-01-04T02:45:17.9205770Z ...................s.ss...................................s.s.....ss.s.. [  4%]
2025-01-04T02:45:18.5692093Z ................s....s.ss.s...s..........s...............s.............s [  4%]
2025-01-04T02:45:20.1010229Z ...s.................................................................... [  5%]
2025-01-04T02:45:20.2628200Z ........................................................................ [  5%]
2025-01-04T02:45:20.4193120Z ........................................................................ [  6%]
2025-01-04T02:45:22.1754339Z ...............s....................s................................... [  6%]
2025-01-04T02:45:23.4868683Z ......s.......s.........................F............................... [  7%]
2025-01-04T02:45:24.0347740Z ........................................................................ [  7%]
2025-01-04T02:45:24.2545606Z ........................................................................ [  8%]
2025-01-04T02:45:24.5258728Z ........................................................................ [  8%]
2025-01-04T02:45:26.3065203Z ........................................................................ [  9%]
2025-01-04T02:45:27.4217722Z .............s......s.s............s.................................... [  9%]
2025-01-04T02:45:32.0218451Z ......................................sssssss.ssssssssss.........s...... [  9%]
2025-01-04T02:45:32.3335212Z ........................................................................ [ 10%]
2025-01-04T02:45:32.5634931Z ...........................................sss.......................... [ 10%]
2025-01-04T02:45:33.9633636Z ........................................................................ [ 11%]
2025-01-04T02:45:35.7730224Z .......................................................................s [ 11%]
2025-01-04T02:45:36.7901872Z ........................................................................ [ 12%]
2025-01-04T02:45:38.9950340Z ........................................................................ [ 12%]
2025-01-04T02:45:43.1430862Z ............................................................s...xxxx.... [ 13%]
2025-01-04T02:45:45.0214720Z ........................................................................ [ 13%]
2025-01-04T02:45:53.4441552Z ...........................................................s............ [ 14%]
2025-01-04T02:46:00.9066659Z s....................................................................... [ 14%]
2025-01-04T02:46:08.3594523Z ...............................................ssss..................... [ 14%]
2025-01-04T02:46:10.5890785Z ..........................................x............................. [ 15%]
2025-01-04T02:46:12.1228239Z ........................................ssssssssssssssssssssssssssssssss [ 15%]
2025-01-04T02:46:12.5688174Z ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 16%]
2025-01-04T02:46:13.8037649Z ssssssssssssssssss.ssssssssss........................................... [ 16%]
2025-01-04T02:46:15.0065968Z .............sx......................................................... [ 17%]
2025-01-04T02:46:28.3185296Z ...........sss....................................s..................... [ 17%]
2025-01-04T02:46:35.5880589Z ........................................................................ [ 18%]
2025-01-04T02:46:44.6677899Z ......................................................................ss [ 18%]
2025-01-04T02:46:47.9480168Z sssssssssssssssssssssss....ssss.......ss................................ [ 19%]
2025-01-04T02:46:53.0697377Z ...............................ssss..................................... [ 19%]
2025-01-04T02:46:58.1367441Z .........s...........s............ss.................................... [ 19%]
2025-01-04T02:47:15.7299622Z ................ssss.........................s...s...................... [ 20%]
2025-01-04T02:47:18.9057660Z ....................................ssss....ssss........................ [ 20%]
2025-01-04T02:47:30.1791653Z .................................x...................................... [ 21%]
2025-01-04T02:47:37.4093468Z .........s.............................................................. [ 21%]
2025-01-04T02:47:44.8630021Z ........................................................................ [ 22%]
2025-01-04T02:47:47.8373035Z ........................................................................ [ 22%]
2025-01-04T02:47:51.5641047Z ............................................sssss....................... [ 23%]
2025-01-04T02:48:07.9879055Z ........................................................................ [ 23%]
2025-01-04T02:48:15.8203640Z ..........ssss...........................................ssssssssssss.ss [ 24%]
2025-01-04T02:48:23.3082734Z ssssssss.sss....ssss.................................................... [ 24%]
2025-01-04T02:50:14.6141413Z ......................................ssss..........s................... [ 24%]
2025-01-04T02:52:04.0383589Z ..ssss........ss............ssss.........F.............................. [ 25%]
2025-01-04T02:52:23.5930849Z ........................................ssss.................ss......... [ 25%]
2025-01-04T02:53:06.5414594Z .............FF.F.FFFFFFF..F...FF.F.FFF...s....F..FF.FFF.FFFFF.FF.FEEEEE [ 26%]
2025-01-04T02:53:14.1888527Z EEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.E..E [ 26%]
2025-01-04T02:53:26.1527323Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEE.EEEEEEEEEEEEEEEEEEE.EE [ 27%]
2025-01-04T02:53:33.6404732Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE [ 27%]
2025-01-04T02:53:41.3767131Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE [ 28%]
2025-01-04T02:53:48.9411253Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEE [ 28%]
2025-01-04T02:53:55.6634467Z EEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE [ 29%]
2025-01-04T02:54:03.2720737Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.EE..EEEEEEEE.EEEEEEEEEEEE....EEEEEEEE [ 29%]
2025-01-04T02:54:09.6114427Z EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEEEE [ 29%]
2025-01-04T02:54:15.9496171Z EEE.EEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEE.EEEEEEEEEEEE.EEEEEEEEEE [ 30%]
2025-01-04T02:54:20.9437830Z .EEEEEEEE.EEEEEEEE.EssssE.EEE..E...E.EEEEEEEE.EEEEEEEEEEEEEEEEEEEEEEE.EE [ 30%]
2025-01-04T02:54:26.7695436Z EEEEEEE.EEEEEEEEEEEEEE.EEEEEEEEEEEEEE.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE.E [ 31%]
2025-01-04T02:54:28.6635072Z EEEEEE.EE..E.E....E..E.E....E...E.....E..........E......E........E.EE... [ 31%]
2025-01-04T02:54:29.5257309Z ..E.....E......EE..E.E.....E.......E..........E.........E............E.E [ 32%]
2025-01-04T02:54:31.6415519Z .E.EE.E.....E..........E......E........E..E.EE.EE.EE.E.E.E.....E...E.E.E [ 32%]
2025-01-04T02:54:33.5969680Z E.EE...........E.........E.........E................EEEEE.EEEEEE.EE.EE.E [ 33%]
2025-01-04T02:54:38.8067575Z E.EE.EEEE.EEEEE..E..EEEEEEEEEE.EEEEEEEEEEEEEEEEE....E.E.......E........E [ 33%]
2025-01-04T02:54:41.1308780Z .............E........E.....E......E......E.EEEEEE..E..EEEEE....E.EEE.EE [ 34%]
2025-01-04T02:54:46.5132628Z E....EEEEEE..E..EEEEE....EEEEEE..E........EEEEEEEE.EEEEE.EEEEEEEE.EEEEEE [ 34%]
2025-01-04T02:54:50.9533423Z E.EEEEEE.EE.........E.........EEEEEEEEEEFEEEEEEFEE.EEEFEEEFEEEEFEEEEEFEE [ 34%]
2025-01-04T02:54:55.0736632Z EEFEE.EEFEEEFEEEEFEEEEFEEE.s.sssEFE.EEFEEEEFEsEEFEEEEFEEEEEFEEEEEEFEEEFE [ 35%]
2025-01-04T02:54:59.5840501Z EEFEEEFEEEEEFEEEEEFEEEFEEEFEEEEFEEEFEEEEFEEEEFEEEEFEEEEEEFEEEEFEEEEEEEFE [ 35%]
2025-01-04T02:55:04.2617973Z EFEEEEFxExEEEEFEEEFEEEEEFEEEEEFEEEEEFEEEEFEEEFEEEFEEEFEEEEEEEEEEEEEEEFEE [ 36%]
2025-01-04T02:55:09.3585039Z .EEEEEEFEEEEEFsEEEEEEFsssEEEEEFxExEEEEFEEEEFEEEEEFEEEEEFEEEEFEEFEEFFFEFE [ 36%]
2025-01-04T02:55:13.9743382Z EEEFEEEEEEFEEEEFEEEFEEEFEEEEEEFEEFEEEEFsEEEEFEsEEEEEEEEEEEFEEEEFEEEEEEEF [ 37%]
2025-01-04T02:55:18.7268027Z EEEEFEEEEEEEE.EFEEEEFEEEFExExEEFEEFEEEFEEEFEEEEEEEFEEEEFEEEEFEEEEFEEEEEE [ 37%]
2025-01-04T02:55:23.8197975Z EEEFEEEEFEEEFEEEEEEEEEEEEEEFEEEEEEEEFEEEEEEFEEEFEEEEFEEEE.EE.EEFEEEFEEEE [ 38%]
2025-01-04T02:55:29.0321329Z FEEEEEFEEEEEEEFEEEEFEEEFEEEFEEEEEEEEEEFEEEEEFE.EEEEEFEEEEEEEEEEEEEFEEEFE [ 38%]
2025-01-04T02:55:32.3333564Z EEEFEEEEEEEEFEEEEFEEEFEEEEF..E.......E.......E........E.EFEEEFEEEEFEEEEF [ 39%]
2025-01-04T02:55:36.2036048Z .E....E.......E..EEEFEEEEEFEEEFEEEEFEEEFEEEEFEEEFEEEEFEEEFEEEFEEEEFEEEFE [ 39%]
2025-01-04T02:55:40.7782946Z EEEFEEEEEFEEEEFEEEEEEEEEEEEEFEEFEEEFEEEFEEEEFEEEFFFF..............EEFEEE [ 39%]
2025-01-04T02:55:42.1550778Z EFEEEFEEEF.....E........E.........E........E..ssssssssssssEsss..E.E.ssEE [ 40%]
2025-01-04T02:55:46.1773110Z EFEEEFEEEEFEEEEFEEEEFEEEFssEEEEFEEFEEEFxxExEEEEFEEEFEEFExxxE.EEEFEEEFssE [ 40%]
2025-01-04T02:55:48.4902490Z .E...sEsssss..E..E..E..ssssssssssssE.E.ss.E.EEFEEEFEEEEFEEEFEEEEEFEEEEEF [ 41%]
2025-01-04T02:55:49.7195062Z EEEFEEEFE.E...ssss..ssssE.....E.ssssss..ssE......E...E...ssssssssssssE.. [ 41%]
2025-01-04T02:55:53.6880154Z .E..E..E.EE.E.E..E..EE.E.E.EEE.E.EEE.EEEE.EEE.EEEEEEE.EEEEE...EEE.EE.EEE [ 42%]
2025-01-04T02:55:58.6788104Z EEEEFEEEEFEEEEEEEFEEEEEEEFEEEEFEEEEEFEEEEEEEEEEEEEEEEEEEEEEEE.EEEEEEEFEE [ 42%]
2025-01-04T02:56:03.8011644Z EEEFEEEEFEEE.EFEEEFEEEEEEFEEFEEEEFE..EEEEEEE.EEEEE.EEEEEEEEEEEEEEEE.E... [ 43%]
2025-01-04T02:56:08.1027196Z ...E.....E.EEEEFEEEEEFEEEEEFEEEEFEEEEFEEEE.ssss.EFEEEE.FEEEEEEFEEEFEEEEE [ 43%]
2025-01-04T02:56:15.1485163Z FEEEEEFEEEEEFEEEFEEEEFE.EEEFEEEEFEEEFEEEFEEEEFEFFFFEEEFEEEEEEEEEEEE.EEEE [ 44%]
2025-01-04T02:56:21.1846121Z EEEEEE.EEEEEEEEEEE.EEEEE.EEEEEEEEEEEEEEEEEEEEEEE...E...EE.EE.EE.E....EEE [ 44%]
2025-01-04T02:56:23.9480883Z FEEEEFEEEFEEEFE..E..EEF.EEEFE.EEEFEEEEF...E.......E....E......E.......E. [ 44%]
2025-01-04T02:56:27.9330450Z .......E........E.EEE.EE.E.E.E..EE.E.EEE.EEEE.EEEEEEEEE...EEEEEEE.EEEE.E [ 45%]
2025-01-04T02:56:31.6539501Z E..EEEEEEEEEE.EEEEEEEEEEE..E......E.E..E...E..E...E...E.E.E.E.EEEEFEEEFE [ 45%]
2025-01-04T02:56:37.0727147Z EEEFEEEEFEEEEFEEEEEFEEEEFEEEFEEEEFEEEFEEEEFEEEEEFEEEEFEEEEFEEEEEEEFEEEEE [ 46%]
2025-01-04T02:56:42.3452411Z FEEEEFEEEFEEEEEEFEEEEEFEEEEEFEEEFEEEEFEEEFEEEEEFEEEEFEEEEEFEEEEFEEFEEEEF [ 46%]
2025-01-04T02:56:48.3645153Z EEEEF.EEEFEEEEF.EEEFEEEFEEEEFEEEEFEEEFEEEEEFEEEEFEEEEEEEEEEE.EEEEEEEEEEE [ 47%]
2025-01-04T02:56:55.0937681Z EEEFEEEFEEFEEEFFFFEFEEEEFEEEEFEEEEEFEEEFEEEEEFEEEEFEEEEFEEEEEFEEEEEEFEEE [ 47%]
2025-01-04T02:57:00.5883992Z EFEEEEEFEEEEEFEEEEFEEEFE.EEEEFEEFEEEEFEEFEEEEFEEEEFEEEFEEEEEFEEEFEEFEEEF [ 48%]
2025-01-04T02:57:06.1368531Z EEFEEEFEEEEFEEEEEEFEFEEEFEEEFEEEEFEEEFEEEFEEEEFEEEEFEEFEEEEEEEEEEEEEEEEE [ 48%]
2025-01-04T02:57:11.6174329Z FEEEEFEEEEFEEEFEEEEFEEEFEEEFE.EEEFEEEEFEEEFEEEFEEEFEEEFEEFEEEFEEEFEEEEFE [ 49%]
2025-01-04T02:57:17.1525732Z .EEFEEEEFEEEFEEEFEEFEEEFEEEFEEEFEEEEEFEEEEFEEEEFEEEFEEEEFEEEEEFEEEEEFEEE [ 49%]
2025-01-04T02:57:25.5655524Z EEFEEEEFEEEEEFEEEFEEEEEFEEEEF.EEEEFEEEEFEEEEFEEEFEEEEFEEEEFEEEEFFFFFFFFF [ 49%]
2025-01-04T02:57:46.6213625Z FF.FFFFFFFFFFFFFFFFF.FFFFFFF.FFFFFFFFFFFFFFFF.FFFFFFFFFFFFFFF.FFFFFFFFFF [ 50%]
2025-01-04T02:58:02.9767614Z FFFFFFFFFFFFFFFFFFFFFFFFFFF.FFFFFFFFFFFFFFFFFFF..F....F.....FF.F.FFF.F.F [ 50%]
2025-01-04T02:58:26.5766185Z .FF.FFFFFF.FF.FFFFFFFFFFFF.FFFFFFFFFFFFFFFFFFFFFFFFFFF.FFFFFFFFFFF.FFF.F [ 51%]
2025-01-04T02:58:59.3206301Z FFF.sFFFF.F..FF...FF.F.F...F.sssFs....ssss.ss..FFFF.FF.FF.FFFFFFFFFFF.FF [ 51%]
2025-01-04T02:59:39.4819685Z FFFFFFF.FFFFFFFFF.FFFFFFFFF.F.FFF.FFFF.FF.FF.FFFFF.FFFFFFFFFF..FFsss..F. [ 52%]
2025-01-04T02:59:46.8868245Z FF.....................FFFFFFFF.F.s..sssssss............F.....F...ss.FF. [ 52%]
2025-01-04T03:00:03.0887852Z .......F...F...F..FFF....sF.FFF.FFF..F.sF..sssss...F.....F..FF.......... [ 53%]
2025-01-04T03:00:03.6353860Z ..F.....................F............................................... [ 53%]
2025-01-04T03:00:08.4388510Z .........EEEEEEEFE.s.sEEEEEEEEEFEEEFEEEEEEEEEEEEEEEEFF.sEEEEEEEEEEEEEFEE [ 54%]
2025-01-04T03:00:13.7460604Z EEEEEEEFEEEEEEEFEEEEEEEEEEEEFEEEEEFEEEEEEEEEEEEEFEEEEEFEEEEEEEEEEEFEEEEE [ 54%]
2025-01-04T03:00:19.0453126Z EEFEEEEEEEEEEEEEEFEEEEEEEEEFEEEEEEEFEEE.EEEEEEEEEFEEEEEF.sEEEEEEEEEEEEEE [ 54%]
2025-01-04T03:00:23.9772578Z EFEEFEEEEEEEEEEEEEFEEEEEEEFEEEEEEEEEEF.EEEEEEEEEEEEEEF.EEEEEEEEEEEFEEEEE [ 55%]
2025-01-04T03:00:42.1002512Z EF.E.EE..........xFFFFFF.F.s.sFFFFF.sFF....FFFFFFFFF.FFFFFF.sFFFFFFFFF.. [ 55%]
2025-01-04T03:01:04.0396597Z ##[error]Process completed with exit code 137.
2025-01-04T03:01:04.1032050Z Post job cleanup.
2025-01-04T03:01:04.2806960Z ##[error]The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
2025-01-04T03:01:04.3642148Z ##[error]The operation was canceled.
2025-01-04T03:01:04.3733436Z Cleaning up orphan processes

@mgorny
Copy link
Contributor Author

mgorny commented Jan 4, 2025

Could you rerun failing builds, please? I think it was a fluke — there's almost no changes (I've only merged main and the protobuf rebuild), and the test passed the previous time around.

@h-vetinari
Copy link
Member

There's a limitation in the UI that I can only restart all failed jobs (includes cancelled jobs), or one. So I prioritised the aarch GPU build first, but now restarted the previous failure too.

@mgorny
Copy link
Contributor Author

mgorny commented Jan 5, 2025

Thanks. So all passed, except for the 3 cancelled jobs. Not sure if you want to rerun them, or just assume they didn't change since the last run.

@h-vetinari h-vetinari merged commit 4d13808 into conda-forge:main Jan 5, 2025
22 of 25 checks passed
@mgorny mgorny deleted the triton-dep branch January 5, 2025 13:23
@mgorny
Copy link
Contributor Author

mgorny commented Jan 5, 2025

Thank you!

@h-vetinari
Copy link
Member

Failure of linux_64_blas_implmklc_compiler_version13cuda_compilercuda-nvcccuda_compiler_version12.6cxx_compiler_version13 after merging:

+ export OMP_NUM_THREADS=4
+ OMP_NUM_THREADS=4
+ python -m pytest -n auto test/test_autograd.py test/test_autograd_fallback.py test/test_custom_ops.py test/test_linalg.py test/test_mkldnn.py test/test_modules.py test/test_nn.py test/test_torch.py test/test_xnnpack_integration.py -m 'not hypothesis' -k 'not ((TestTorch and test_print))' --durations=50
============================= test session starts ==============================
platform linux -- Python 3.9.21, pytest-8.3.4, pluggy-1.5.0
rootdir: $SRC_DIR
plugins: rerunfailures-15.0, hypothesis-6.123.3, flakefinder-1.1.0, xdist-3.6.1
created: 8/8 workers
8 workers [15882 items]

.s..ss...s.s...ssss..ss...ss...sss.sss..sss.....ssss..sss..ssss..s.....s [  0%]
ss.s.s..s......s.ss.s.s....s.s.s.sss......s.s.ss.....s.sssss....ssss.... [  0%]
s.s.ssss.....sssss....s.ssss....s.sss....s..s.s.s....s.s..s.s..s.....s.s [  1%]
s....s..sss.s.....s.s..ss.s.....sss.ss.....sss.s.s..s.s..s.ss.s.s.ssssss [  1%]
sssssss.s.ssssssssssssssssssssssss..ssssss...s.s.s.ssssssssss.ssss.sssss [  2%]
ssssss.ss.ssssssssssssssss...ssssssssssssssssssssssssssssssss.ssssssssss [  2%]
sssssss................................................................. [  3%]
...................s.................................................... [  3%]
........................................................................ [  4%]
..............ss.s.s............sss..................................... [  4%]
................................................................s.s..... [  4%]
ss..s..................s....s.ss.s...s.........s..........s......s.s.... [  5%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  6%]
........................................................................ [  7%]
.........s........................s.................sssss.ssssssssssss.. [  7%]
........................................................................ [  8%]
.................................................s.....ss............s.. [  8%]
..................................................s..................... [  9%]
........................................................................ [  9%]
...................................sss.................................. [  9%]
...............................................................s........ [ 10%]
........................................................................ [ 10%]
.......................ss............................................... [ 11%]
........................................................................ [ 11%]
........................................................................ [ 12%]
..............................................................x......ssx [ 12%]
sss.......x......x............................ssss...................... [ 13%]
..........................................................sssss.ssssssss [ 13%]
ssssssssssss....ssss.................................................... [ 14%]
.....................ss..ss..........xx........................ssss..... [ 14%]
......xx.........x.x.x........xx...x.xxssxx..x..ssss.ss...............ss [ 14%]
.............ssssssss.ssssssssss.ss.......ss....s....s.................. [ 15%]
........................................................................ [ 15%]
........................................................................ [ 16%]
.....................ss....xx....xx..ss....ssssss.........ssssssssssss.. [ 16%]
ss...............................ssssss..ss............ssssssssssss..... [ 17%]
.sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 17%]
ssssssssssssssssssssssssssssssss...........................ssss......... [ 18%]
........................s............................................... [ 18%]
s...................................................................x... [ 19%]
........................................................................ [ 19%]
........................................................................ [ 19%]
..................................................sx.................... [ 20%]
..............................................sss....................s.. [ 20%]
........................................................................ [ 21%]
.....................ssss........................................s.sss.. [ 21%]
.......s....s.ssssssssssss.sss.......................................... [ 22%]
........................................................................ [ 22%]
.......................................................sss.s.......ssss. [ 23%]
ss.ss......s....s....................................................... [ 23%]
........................................x............................... [ 24%]
........................................................................ [ 24%]
s.............................s......................................... [ 24%]
..ssss.sssssss..s.sssss...ssssssssss.ssssssssssssss.sssss..sssss.sssss.s [ 25%]
..ssssss.sss.ssssssss.sssssss.ssssssss.sssssssssssssssssssssssssssssssss [ 25%]
ssssssssssssssssssssssssssssssssssssssssssssssssssssssss.sssssssssssssss [ 26%]
ssssssssssssssssssssssssssssssssssssssss................................ [ 26%]
........................................................................ [ 27%]
........................................................................ [ 27%]
......s...sssss..ssss...ssssss..ssss..sssss...................ssss...... [ 28%]
........................................................................ [ 28%]
........................................................................ [ 29%]
.................................................s..s..s.s.............. [ 29%]
.......................................................................s [ 29%]
..................................s..................................... [ 30%]
...ssssssssssssssssssssssssssssssssssssssssssssssssss.ssssssssssssssssss [ 30%]
sss..sssssssssssssssssssssssssssss...................................... [ 31%]
.....................................................................ss. [ 31%]
s.s..................................................................... [ 32%]
........................................................................ [ 32%]
.............................s.......................................... [ 33%]
........................................................................ [ 33%]
........................................................................ [ 34%]
........................................................................ [ 34%]
.....sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 34%]
sssssssssssssssssssss.ssssssssssssssssssssssssssssssssssssssssssssssssss [ 35%]
sssssssssssssssssssss......................................x.x..x...ssx. [ 35%]
.............................s.......................................... [ 36%]
.........ssss.....ssss.ss............................................... [ 36%]
./.scripts/run_docker_build.sh: line 108:  2493 Killed                  docker run ${DOCKER_RUN_ARGS} -v "${RECIPE_ROOT}":/home/conda/recipe_root:rw,z,delegated -v "${FEEDSTOCK_ROOT}":/home/conda/feedstock_root:rw,z,delegated -e CONFIG -e HOST_USER_ID -e UPLOAD_PACKAGES -e IS_PR_BUILD -e GIT_BRANCH -e UPLOAD_ON_BRANCH -e CI -e FEEDSTOCK_NAME -e CPU_COUNT -e BUILD_WITH_CONDA_DEBUG -e BUILD_OUTPUT_ID -e flow_run_id -e remote_url -e sha -e BINSTAR_TOKEN -e FEEDSTOCK_TOKEN -e STAGING_BINSTAR_TOKEN "${DOCKER_IMAGE}" bash "/home/conda/feedstock_root/${PROVIDER_DIR}/build_steps.sh"
##[error]Process completed with exit code 137.

Perhaps also due to resource issues?

@mgorny
Copy link
Contributor Author

mgorny commented Jan 6, 2025

Hrm, no clue. Could it have OOM-ed perhaps?

@mgorny
Copy link
Contributor Author

mgorny commented Jan 6, 2025

Do you want me to try addressing it separately, or wait and see if we can get kineto passing first, and perhaps the same solution will work for both cases?

@h-vetinari
Copy link
Member

You can keep working on it of course. In the meantime I'll see if I can nurse the CI on main to success by restarting (but the queue seems long at the moment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants