Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: Failed to build from source due to unavailable rapids-dask-dependency #4008

Closed
2 tasks done
huiyuxie opened this issue Nov 17, 2023 · 3 comments · Fixed by #4024
Closed
2 tasks done

[BUG]: Failed to build from source due to unavailable rapids-dask-dependency #4008

huiyuxie opened this issue Nov 17, 2023 · 3 comments · Fixed by #4024
Assignees
Labels
bug Something isn't working

Comments

@huiyuxie
Copy link
Contributor

Version

23.12

Which installation method(s) does this occur on?

Source

Describe the bug.

This issue is related to the recent commits #3991. Building from source worked well several days ago, but after these commits, the process failed. The errors came from the process here https://github.com/rapidsai/cugraph/blob/branch-23.12/docs/cugraph/source/installation/source_build.md#building-and-installing-the-python-package. The pylibcugraph could be installed without errors but cugraph python bindings could not.

The output showed that error: Could not find suitable distribution for Requirement.parse('rapids-dask-dependency==23.12.*'). I think this might be because rapids-dask-dependency is a relatively new package that has not yet been published to PyPI. I'm not certain if this qualifies as a real bug, but since the issue is closely related to one, I've labeled it as a bug.

Is it better to add this metapackage to dependencies later when its link becomes available on https://pypi.org/simple/, or is there another way to build from source, specifically during the installation process, to avoid these errors?

Minimum reproducible example

cd $CUGRAPH_HOME/python/cugraph
python setup.py build_ext --inplace
python setup.py install

Relevant log output

(cugraph_dev) ubuntu@ip-172-31-7-163:~/cugraph/python/cugraph$ python setup.py install 
... 

Installed /home/ubuntu/miniconda3/envs/cugraph_dev/lib/python3.10/site-packages/cugraph-23.12.0-py3.10-linux-x86_64.egg
Processing dependencies for cugraph==23.12.0
Searching for rapids-dask-dependency==23.12.*
Reading https://pypi.org/simple/rapids-dask-dependency/
Couldn't find index page for 'rapids-dask-dependency' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading https://pypi.org/simple/
No local packages or working download links found for rapids-dask-dependency==23.12.*
error: Could not find suitable distribution for Requirement.parse('rapids-dask-dependency==23.12.*')

Environment details

<details><summary>Click here to see environment details</summary><pre>
     
     **git***
     commit 4cec6497dc6e0f9b4b3a871198e846db185b7348 (HEAD -> branch-23.12, origin/branch-23.12, origin/HEAD)
     Merge: 1e5adcf3 8c104a52
     Author: Huiyu Xie <[email protected]>
     Date:   Thu Nov 16 11:11:26 2023 -0800
     
     Merge branch 'rapidsai:branch-23.12' into branch-23.12
     **git submodules***
     
     ***OS Information***
     DISTRIB_ID=Ubuntu
     DISTRIB_RELEASE=22.04
     DISTRIB_CODENAME=jammy
     DISTRIB_DESCRIPTION="Ubuntu 22.04.2 LTS"
     PRETTY_NAME="Ubuntu 22.04.2 LTS"
     NAME="Ubuntu"
     VERSION_ID="22.04"
     VERSION="22.04.2 LTS (Jammy Jellyfish)"
     VERSION_CODENAME=jammy
     ID=ubuntu
     ID_LIKE=debian
     HOME_URL="https://www.ubuntu.com/"
     SUPPORT_URL="https://help.ubuntu.com/"
     BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
     PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
     UBUNTU_CODENAME=jammy
     Linux ip-172-31-7-163 6.2.0-1015-aws #15~22.04.1-Ubuntu SMP Fri Oct  6 21:37:24 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
     
     ***GPU Information***
     Fri Nov 17 09:05:12 2023
     +---------------------------------------------------------------------------------------+
     | NVIDIA-SMI 530.30.02              Driver Version: 530.30.02    CUDA Version: 12.1     |
     |-----------------------------------------+----------------------+----------------------+
     | GPU  Name                  Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
     | Fan  Temp  Perf            Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
     |                                         |                      |               MIG M. |
     |=========================================+======================+======================|
     |   0  Tesla V100-SXM2-16GB            On | 00000000:00:1E.0 Off |                    0 |
     | N/A   30C    P0               22W / 300W|      0MiB / 16384MiB |      0%      Default |
     |                                         |                      |                  N/A |
     +-----------------------------------------+----------------------+----------------------+
     
     +---------------------------------------------------------------------------------------+
     | Processes:                                                                            |
     |  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
     |        ID   ID                                                             Usage      |
     |=======================================================================================|
     |  No running processes found                                                           |
     +---------------------------------------------------------------------------------------+
     
     ***CPU***
     Architecture:                       x86_64
     CPU op-mode(s):                     32-bit, 64-bit
     Address sizes:                      46 bits physical, 48 bits virtual
     Byte Order:                         Little Endian
     CPU(s):                             8
     On-line CPU(s) list:                0-7
     Vendor ID:                          GenuineIntel
     Model name:                         Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
     CPU family:                         6
     Model:                              79
     Thread(s) per core:                 2
     Core(s) per socket:                 4
     Socket(s):                          1
     Stepping:                           1
     CPU max MHz:                        3000.0000
     CPU min MHz:                        1200.0000
     BogoMIPS:                           4600.04
     Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx xsaveopt
     Hypervisor vendor:                  Xen
     Virtualization type:                full
     L1d cache:                          128 KiB (4 instances)
     L1i cache:                          128 KiB (4 instances)
     L2 cache:                           1 MiB (4 instances)
     L3 cache:                           45 MiB (1 instance)
     NUMA node(s):                       1
     NUMA node0 CPU(s):                  0-7
     Vulnerability Gather data sampling: Not affected
     Vulnerability Itlb multihit:        KVM: Mitigation: VMX unsupported
     Vulnerability L1tf:                 Mitigation; PTE Inversion
     Vulnerability Mds:                  Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
     Vulnerability Meltdown:             Mitigation; PTI
     Vulnerability Mmio stale data:      Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
     Vulnerability Retbleed:             Not affected
     Vulnerability Spec rstack overflow: Not affected
     Vulnerability Spec store bypass:    Vulnerable
     Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
     Vulnerability Spectre v2:           Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
     Vulnerability Srbds:                Not affected
     Vulnerability Tsx async abort:      Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
     
     ***CMake***
     /home/ubuntu/miniconda3/envs/cugraph_dev/bin/cmake
     cmake version 3.27.6
     
     CMake suite maintained and supported by Kitware (kitware.com/cmake).
     
     ***g++***
     /home/ubuntu/miniconda3/envs/cugraph_dev/bin/g++
     g++ (conda-forge gcc 11.4.0-3) 11.4.0
     Copyright (C) 2021 Free Software Foundation, Inc.
     This is free software; see the source for copying conditions.  There is NO
     warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
     
     
     ***nvcc***
     /usr/local/cuda-12.1/bin/nvcc
     nvcc: NVIDIA (R) Cuda compiler driver
     Copyright (c) 2005-2023 NVIDIA Corporation
     Built on Mon_Apr__3_17:16:06_PDT_2023
     Cuda compilation tools, release 12.1, V12.1.105
     Build cuda_12.1.r12.1/compiler.32688072_0
     
     ***Python***
     /home/ubuntu/miniconda3/envs/cugraph_dev/bin/python
     Python 3.10.13
     
     ***Environment Variables***
     PATH                            : /usr/local/cuda-12.1/bin:/home/ubuntu/.vscode-server/bin/1a5daa3a0231a0fbba4f14db7ec463cf99d7768e/bin/remote-cli:/home/ubuntu/miniconda3/envs/cugraph_dev/bin:/home/ubuntu/miniconda3/condabin:/usr/local/cuda-12.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
     LD_LIBRARY_PATH                 : /usr/local/cuda-12.1/lib64:/usr/local/cuda-12.1/lib64:
     NUMBAPRO_NVVM                   :
     NUMBAPRO_LIBDEVICE              :
     CONDA_PREFIX                    : /home/ubuntu/miniconda3/envs/cugraph_dev
     PYTHON_PATH                     :
     
     ***conda packages***
     /home/ubuntu/miniconda3/condabin/conda
     # packages in environment at /home/ubuntu/miniconda3/envs/cugraph_dev:
     #
     # Name                    Version                   Build  Channel
     _libgcc_mutex             0.1                 conda_forge    conda-forge
     _openmp_mutex             4.5                       2_gnu    conda-forge
     _sysroot_linux-64_curr_repodata_hack 3                   h69a702a_13    conda-forge
     accessible-pygments       0.0.4              pyhd8ed1ab_0    conda-forge
     aiohttp                   3.8.6           py310h2372a71_1    conda-forge
     aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
     alabaster                 0.7.13             pyhd8ed1ab_0    conda-forge
     anyio                     4.0.0              pyhd8ed1ab_0    conda-forge
     argon2-cffi               23.1.0             pyhd8ed1ab_0    conda-forge
     argon2-cffi-bindings      21.2.0          py310h2372a71_4    conda-forge
     arrow                     1.3.0              pyhd8ed1ab_0    conda-forge
     asttokens                 2.4.1              pyhd8ed1ab_0    conda-forge
     async-lru                 2.0.4              pyhd8ed1ab_0    conda-forge
     async-timeout             4.0.3              pyhd8ed1ab_0    conda-forge
     atk-1.0                   2.38.0               hd4edc92_1    conda-forge
     attrs                     23.1.0             pyh71513ae_1    conda-forge
     aws-c-auth                0.7.6                h37ad1db_0    conda-forge
     aws-c-cal                 0.6.9                h3b91eb8_1    conda-forge
     aws-c-common              0.9.8                hd590300_0    conda-forge
     aws-c-compression         0.2.17               hfd9eb17_6    conda-forge
     aws-c-event-stream        0.3.2                hae413d4_6    conda-forge
     aws-c-http                0.7.14               h162056d_1    conda-forge
     aws-c-io                  0.13.35              hc23c90e_8    conda-forge
     aws-c-mqtt                0.9.9                h1387108_0    conda-forge
     aws-c-s3                  0.3.23               h7630044_1    conda-forge
     aws-c-sdkutils            0.1.12               hfd9eb17_5    conda-forge
     aws-checksums             0.1.17               hfd9eb17_5    conda-forge
     aws-crt-cpp               0.24.5               h270613d_5    conda-forge
     aws-sdk-cpp               1.11.182             h8df25a1_5    conda-forge
     babel                     2.13.1             pyhd8ed1ab_0    conda-forge
     backports                 1.0                pyhd8ed1ab_3    conda-forge
     backports.functools_lru_cache 1.6.5              pyhd8ed1ab_0    conda-forge
     beautifulsoup4            4.12.2             pyha770c72_0    conda-forge
     binutils                  2.40                 hdd6e379_0    conda-forge
     binutils_impl_linux-64    2.40                 hf600244_0    conda-forge
     binutils_linux-64         2.40                 hbdbef99_2    conda-forge
     bleach                    6.1.0              pyhd8ed1ab_0    conda-forge
     bokeh                     3.3.1              pyhd8ed1ab_0    conda-forge
     breathe                   4.35.0             pyhd8ed1ab_1    conda-forge
     brotli                    1.1.0                hd590300_1    conda-forge
     brotli-bin                1.1.0                hd590300_1    conda-forge
     brotli-python             1.1.0           py310hc6cd4ac_1    conda-forge
     bzip2                     1.0.8                hd590300_5    conda-forge
     c-ares                    1.21.0               hd590300_0    conda-forge
     c-compiler                1.5.2                h0b41bf4_0    conda-forge
     ca-certificates           2023.7.22            hbcca054_0    conda-forge
     cached-property           1.5.2                hd8ed1ab_1    conda-forge
     cached_property           1.5.2              pyha770c72_1    conda-forge
     cachetools                5.3.2              pyhd8ed1ab_0    conda-forge
     cairo                     1.18.0               h3faef2a_0    conda-forge
     certifi                   2023.7.22          pyhd8ed1ab_0    conda-forge
     cffi                      1.16.0          py310h2fee648_0    conda-forge
     cfgv                      3.3.1              pyhd8ed1ab_0    conda-forge
     charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
     click                     8.1.7           unix_pyh707e725_0    conda-forge
     cloudpickle               3.0.0              pyhd8ed1ab_0    conda-forge
     cmake                     3.27.6               hcfe8598_0    conda-forge
     colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
     comm                      0.1.4              pyhd8ed1ab_0    conda-forge
     commonmark                0.9.1                      py_0    conda-forge
     contourpy                 1.2.0           py310hd41b1e2_0    conda-forge
     coverage                  7.3.2           py310h2372a71_0    conda-forge
     cuda-cccl_linux-64        12.0.90              ha770c72_1    conda-forge
     cuda-cudart               12.0.107             h59595ed_6    conda-forge
     cuda-cudart-dev           12.0.107             h59595ed_6    conda-forge
     cuda-cudart-dev_linux-64  12.0.107             h59595ed_6    conda-forge
     cuda-cudart-static        12.0.107             h59595ed_6    conda-forge
     cuda-cudart-static_linux-64 12.0.107             h59595ed_6    conda-forge
     cuda-cudart_linux-64      12.0.107             h59595ed_6    conda-forge
     cuda-driver-dev_linux-64  12.0.107             h59595ed_6    conda-forge
     cuda-nvcc                 12.0.76              hba56722_6    conda-forge
     cuda-nvcc-dev_linux-64    12.0.76              ha770c72_1    conda-forge
     cuda-nvcc-impl            12.0.76              h59595ed_1    conda-forge
     cuda-nvcc-tools           12.0.76              h59595ed_1    conda-forge
     cuda-nvcc_linux-64        12.0.76             hba56722_12    conda-forge
     cuda-nvrtc                12.0.76              h59595ed_1    conda-forge
     cuda-nvtx                 12.0.76              hcb278e6_0    conda-forge
     cuda-profiler-api         12.0.76              ha770c72_0    conda-forge
     cuda-python               11.8.3                   pypi_0    pypi
     cuda-version              12.0                 hffde075_2    conda-forge
     cudf                      23.12.00a686    cuda12_py310_231110_g87d2a36f04_686    rapidsai-nightly
     cugraph                   23.12.0                  pypi_0    pypi
     cupy                      12.2.0          py310he66c036_3    conda-forge
     cxx-compiler              1.5.2                hf52228f_0    conda-forge
     cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
     cython                    3.0.5           py310hc6cd4ac_0    conda-forge
     cytoolz                   0.12.2          py310h2372a71_1    conda-forge
     dask                      2023.10.2a231110 py_g8212868a_13    dask/label/dev
     dask-core                 2023.10.2a231110 py_g972352a29_9    dask/label/dev
     dask-cuda                 23.12.00a26     py310_231109_ge5b240c_26    rapidsai-nightly
     dask-cudf                 23.12.00a686    cuda12_py310_231110_g87d2a36f04_686    rapidsai-nightly
     debugpy                   1.8.0           py310hc6cd4ac_1    conda-forge
     decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
     defusedxml                0.7.1              pyhd8ed1ab_0    conda-forge
     distlib                   0.3.7              pyhd8ed1ab_0    conda-forge
     distributed               2023.10.2a231110 py_g8212868a_13    dask/label/dev
     distro                    1.8.0              pyhd8ed1ab_0    conda-forge
     dlpack                    0.5                  h9c3ff4c_0    conda-forge
     docutils                  0.19            py310hff52083_1    conda-forge
     doxygen                   1.9.8                h661eb56_0    conda-forge
     entrypoints               0.4                pyhd8ed1ab_0    conda-forge
     exceptiongroup            1.1.3              pyhd8ed1ab_0    conda-forge
     execnet                   2.0.2              pyhd8ed1ab_0    conda-forge
     executing                 2.0.1              pyhd8ed1ab_0    conda-forge
     expat                     2.5.0                hcb278e6_1    conda-forge
     fastrlock                 0.8.2           py310hc6cd4ac_1    conda-forge
     filelock                  3.13.1             pyhd8ed1ab_0    conda-forge
     fmt                       9.1.0                h924138e_0    conda-forge
     font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
     font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
     font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
     font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
     fontconfig                2.14.2               h14ed4e7_0    conda-forge
     fonts-conda-ecosystem     1                             0    conda-forge
     fonts-conda-forge         1                             0    conda-forge
     fonttools                 4.44.0          py310h2372a71_0    conda-forge
     fqdn                      1.5.1              pyhd8ed1ab_0    conda-forge
     freetype                  2.12.1               h267a509_2    conda-forge
     fribidi                   1.0.10               h36c2ea0_0    conda-forge
     frozenlist                1.4.0           py310h2372a71_1    conda-forge
     fsspec                    2023.10.0          pyhca7485f_0    conda-forge
     future                    0.18.3             pyhd8ed1ab_0    conda-forge
     gcc                       11.4.0               h7baecda_2    conda-forge
     gcc_impl_linux-64         11.4.0               h7aa1c59_3    conda-forge
     gcc_linux-64              11.4.0               hfd045f2_2    conda-forge
     gdk-pixbuf                2.42.10              h829c605_4    conda-forge
     gettext                   0.21.1               h27087fc_0    conda-forge
     gflags                    2.2.2             he1b5a44_1004    conda-forge
     giflib                    5.2.1                h0b41bf4_3    conda-forge
     glog                      0.6.0                h6f12383_0    conda-forge
     gmock                     1.14.0               ha770c72_1    conda-forge
     gmp                       6.3.0                h59595ed_0    conda-forge
     graphite2                 1.3.13            h58526e2_1001    conda-forge
     graphviz                  8.1.0                h28d9a01_0    conda-forge
     gtest                     1.14.0               h00ab1b0_1    conda-forge
     gtk2                      2.24.33              h90689f9_2    conda-forge
     gts                       0.7.6                h977cf35_4    conda-forge
     gxx                       11.4.0               h7baecda_2    conda-forge
     gxx_impl_linux-64         11.4.0               h7aa1c59_3    conda-forge
     gxx_linux-64              11.4.0               hfc1ae95_2    conda-forge
     harfbuzz                  8.2.1                h3d44ed6_0    conda-forge
     icu                       73.2                 h59595ed_0    conda-forge
     identify                  2.5.31             pyhd8ed1ab_0    conda-forge
     idna                      3.4                pyhd8ed1ab_0    conda-forge
     imagesize                 1.4.1              pyhd8ed1ab_0    conda-forge
     importlib-metadata        6.8.0              pyha770c72_0    conda-forge
     importlib_metadata        6.8.0                hd8ed1ab_0    conda-forge
     importlib_resources       6.1.1              pyhd8ed1ab_0    conda-forge
     iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
     ipykernel                 6.26.0             pyhf8b6a83_0    conda-forge
     ipython                   8.17.2             pyh41d4057_0    conda-forge
     isoduration               20.11.0            pyhd8ed1ab_0    conda-forge
     jedi                      0.19.1             pyhd8ed1ab_0    conda-forge
     jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
     joblib                    1.3.2              pyhd8ed1ab_0    conda-forge
     json5                     0.9.14             pyhd8ed1ab_0    conda-forge
     jsonpointer               2.4             py310hff52083_3    conda-forge
     jsonschema                4.19.2             pyhd8ed1ab_0    conda-forge
     jsonschema-specifications 2023.7.1           pyhd8ed1ab_0    conda-forge
     jsonschema-with-format-nongpl 4.19.2             pyhd8ed1ab_0    conda-forge
     jupyter-lsp               2.2.0              pyhd8ed1ab_0    conda-forge
     jupyter_client            8.6.0              pyhd8ed1ab_0    conda-forge
     jupyter_core              5.5.0           py310hff52083_0    conda-forge
     jupyter_events            0.9.0              pyhd8ed1ab_0    conda-forge
     jupyter_server            2.10.0             pyhd8ed1ab_0    conda-forge
     jupyter_server_terminals  0.4.4              pyhd8ed1ab_1    conda-forge
     jupyterlab                4.0.8              pyhd8ed1ab_0    conda-forge
     jupyterlab_pygments       0.2.2              pyhd8ed1ab_0    conda-forge
     jupyterlab_server         2.25.1             pyhd8ed1ab_0    conda-forge
     kernel-headers_linux-64   3.10.0              h4a8ded7_13    conda-forge
     keyutils                  1.6.1                h166bdaf_0    conda-forge
     kiwisolver                1.4.5           py310hd41b1e2_1    conda-forge
     krb5                      1.21.2               h659d440_0    conda-forge
     lcms2                     2.15                 hb7c19ff_3    conda-forge
     ld_impl_linux-64          2.40                 h41732ed_0    conda-forge
     lerc                      4.0.0                h27087fc_0    conda-forge
     libabseil                 20230802.1      cxx17_h59595ed_0    conda-forge
     libarrow                  14.0.1           h0406937_1_cpu    conda-forge
     libarrow-acero            14.0.1           h59595ed_1_cpu    conda-forge
     libarrow-dataset          14.0.1           h59595ed_1_cpu    conda-forge
     libarrow-flight           14.0.1           h120cb0d_1_cpu    conda-forge
     libarrow-flight-sql       14.0.1           h61ff412_1_cpu    conda-forge
     libarrow-gandiva          14.0.1           hacb8726_1_cpu    conda-forge
     libarrow-substrait        14.0.1           h61ff412_1_cpu    conda-forge
     libblas                   3.9.0           19_linux64_openblas    conda-forge
     libbrotlicommon           1.1.0                hd590300_1    conda-forge
     libbrotlidec              1.1.0                hd590300_1    conda-forge
     libbrotlienc              1.1.0                hd590300_1    conda-forge
     libcblas                  3.9.0           19_linux64_openblas    conda-forge
     libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
     libcublas                 12.0.1.189           hcb278e6_2    conda-forge
     libcublas-dev             12.0.1.189           hcb278e6_2    conda-forge
     libcudf                   23.12.00a686    cuda12_231110_g87d2a36f04_686    rapidsai-nightly
     libcufft                  11.0.0.21            hcb278e6_1    conda-forge
     libcufile                 1.5.0.59             hcb278e6_0    conda-forge
     libcufile-dev             1.5.0.59             hcb278e6_0    conda-forge
     libcugraphops             23.12.00a14     cuda12_231110_g207773d3_14    rapidsai-nightly
     libcurand                 10.3.1.50            hcb278e6_0    conda-forge
     libcurand-dev             10.3.1.50            hcb278e6_0    conda-forge
     libcurl                   8.4.0                hca28451_0    conda-forge
     libcusolver               11.4.2.57            hcb278e6_1    conda-forge
     libcusolver-dev           11.4.2.57            hcb278e6_1    conda-forge
     libcusparse               12.0.0.76            hcb278e6_1    conda-forge
     libcusparse-dev           12.0.0.76            hcb278e6_1    conda-forge
     libdeflate                1.19                 hd590300_0    conda-forge
     libedit                   3.1.20191231         he28a2e2_2    conda-forge
     libev                     4.33                 h516909a_1    conda-forge
     libevent                  2.1.12               hf998b51_1    conda-forge
     libexpat                  2.5.0                hcb278e6_1    conda-forge
     libffi                    3.4.2                h7f98852_5    conda-forge
     libgcc-devel_linux-64     11.4.0             h922705a_103    conda-forge
     libgcc-ng                 13.2.0               h807b86a_3    conda-forge
     libgd                     2.3.3                h119a65a_9    conda-forge
     libgfortran-ng            13.2.0               h69a702a_3    conda-forge
     libgfortran5              13.2.0               ha4646dd_3    conda-forge
     libglib                   2.78.1               hebfc3b9_0    conda-forge
     libgomp                   13.2.0               h807b86a_3    conda-forge
     libgoogle-cloud           2.12.0               h5206363_4    conda-forge
     libgrpc                   1.59.2               hd6c4280_0    conda-forge
     libiconv                  1.17                 h166bdaf_0    conda-forge
     libidn2                   2.3.4                h166bdaf_0    conda-forge
     libjpeg-turbo             3.0.0                hd590300_1    conda-forge
     libkvikio                 23.12.00a       cuda12_231109_ge1762f2_20    rapidsai-nightly
     liblapack                 3.9.0           19_linux64_openblas    conda-forge
     libllvm14                 14.0.6               hcd5def8_4    conda-forge
     libllvm15                 15.0.7               h5cf9203_3    conda-forge
     libnghttp2                1.58.0               h47da74e_0    conda-forge
     libnsl                    2.0.1                hd590300_0    conda-forge
     libnuma                   2.0.16               h0b41bf4_1    conda-forge
     libnvjitlink              12.0.76              hcb278e6_1    conda-forge
     libopenblas               0.3.24          pthreads_h413a1c8_0    conda-forge
     libparquet                14.0.1           h352af49_1_cpu    conda-forge
     libpng                    1.6.39               h753d276_0    conda-forge
     libprotobuf               4.24.4               hf27288f_0    conda-forge
     libraft                   23.12.00a85     cuda12_231108_g42512f73_85    rapidsai-nightly
     libraft-headers           23.12.00a85     cuda12_231108_g42512f73_85    rapidsai-nightly
     libraft-headers-only      23.12.00a85     cuda12_231108_g42512f73_85    rapidsai-nightly
     libre2-11                 2023.06.02           h7a70373_0    conda-forge
     librmm                    23.12.00a21     cuda12_231109_gd407fd38_21    rapidsai-nightly
     librsvg                   2.56.3               h98fae49_0    conda-forge
     libsanitizer              11.4.0               h4dcbe23_3    conda-forge
     libsodium                 1.0.18               h36c2ea0_1    conda-forge
     libsqlite                 3.44.0               h2797004_0    conda-forge
     libssh2                   1.11.0               h0841786_0    conda-forge
     libstdcxx-devel_linux-64  11.4.0             h922705a_103    conda-forge
     libstdcxx-ng              13.2.0               h7e041cc_3    conda-forge
     libthrift                 0.19.0               hb90f79a_1    conda-forge
     libtiff                   4.6.0                ha9c0a0a_2    conda-forge
     libtool                   2.4.7                h27087fc_0    conda-forge
     libunistring              0.9.10               h7f98852_0    conda-forge
     libutf8proc               2.8.0                h166bdaf_0    conda-forge
     libuuid                   2.38.1               h0b41bf4_0    conda-forge
     libuv                     1.46.0               hd590300_0    conda-forge
     libwebp                   1.3.2                h658648e_1    conda-forge
     libwebp-base              1.3.2                hd590300_0    conda-forge
     libwholegraph             23.12.00a13     cuda12_231109_gc3bd5ef_13    rapidsai-nightly
     libxcb                    1.15                 h0b41bf4_0    conda-forge
     libxml2                   2.11.5               h232c23b_1    conda-forge
     libzlib                   1.2.13               hd590300_5    conda-forge
     llvmlite                  0.40.1          py310h1b8f574_0    conda-forge
     locket                    1.0.0              pyhd8ed1ab_0    conda-forge
     lz4                       4.3.2           py310h350c4a5_1    conda-forge
     lz4-c                     1.9.4                hcb278e6_0    conda-forge
     markdown                  3.5.1              pyhd8ed1ab_0    conda-forge
     markdown-it-py            3.0.0              pyhd8ed1ab_0    conda-forge
     markupsafe                2.1.3           py310h2372a71_1    conda-forge
     matplotlib-base           3.8.1           py310h62c0568_0    conda-forge
     matplotlib-inline         0.1.6              pyhd8ed1ab_0    conda-forge
     mdurl                     0.1.0              pyhd8ed1ab_0    conda-forge
     mistune                   3.0.2              pyhd8ed1ab_0    conda-forge
     mpi                       1.0                     openmpi    conda-forge
     msgpack-python            1.0.6           py310hd41b1e2_0    conda-forge
     multidict                 6.0.4           py310h2372a71_1    conda-forge
     munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
     nbclient                  0.8.0              pyhd8ed1ab_0    conda-forge
     nbconvert                 7.11.0             pyhd8ed1ab_0    conda-forge
     nbconvert-core            7.11.0             pyhd8ed1ab_0    conda-forge
     nbconvert-pandoc          7.11.0             pyhd8ed1ab_0    conda-forge
     nbformat                  5.9.2              pyhd8ed1ab_0    conda-forge
     nbsphinx                  0.9.3              pyhd8ed1ab_0    conda-forge
     nccl                      2.19.3.1             h3a97aeb_0    conda-forge
     ncurses                   6.4                  h59595ed_2    conda-forge
     nest-asyncio              1.5.8              pyhd8ed1ab_0    conda-forge
     networkx                  3.2.1              pyhd8ed1ab_0    conda-forge
     ninja                     1.11.1               h924138e_0    conda-forge
     nodeenv                   1.8.0              pyhd8ed1ab_0    conda-forge
     notebook                  7.0.6              pyhd8ed1ab_0    conda-forge
     notebook-shim             0.2.3              pyhd8ed1ab_0    conda-forge
     numba                     0.57.1          py310h0f6aa51_0    conda-forge
     numpy                     1.24.4          py310ha4c1d20_0    conda-forge
     numpydoc                  1.5.0              pyhd8ed1ab_0    conda-forge
     nvcomp                    3.0.4                h3a97aeb_0    conda-forge
     nvtx                      0.2.8           py310h2372a71_1    conda-forge
     openjpeg                  2.5.0                h488ebb8_3    conda-forge
     openmpi                   4.1.6              hc5af2df_101    conda-forge
     openssl                   3.1.4                hd590300_0    conda-forge
     orc                       1.9.0                h4b38347_4    conda-forge
     overrides                 7.4.0              pyhd8ed1ab_0    conda-forge
     packaging                 23.2               pyhd8ed1ab_0    conda-forge
     pandas                    1.5.3           py310h9b08913_1    conda-forge
     pandoc                    3.1.3                h32600fe_0    conda-forge
     pandocfilters             1.5.0              pyhd8ed1ab_0    conda-forge
     pango                     1.50.14              ha41ecd1_2    conda-forge
     parso                     0.8.3              pyhd8ed1ab_0    conda-forge
     partd                     1.4.1              pyhd8ed1ab_0    conda-forge
     pcre2                     10.40                hc3806b6_0    conda-forge
     pexpect                   4.8.0              pyh1a96a4e_2    conda-forge
     pickleshare               0.7.5                   py_1003    conda-forge
     pillow                    10.1.0          py310h01dd4db_0    conda-forge
     pip                       23.3.1             pyhd8ed1ab_0    conda-forge
     pixman                    0.42.2               h59595ed_0    conda-forge
     pkgutil-resolve-name      1.3.10             pyhd8ed1ab_1    conda-forge
     platformdirs              3.11.0             pyhd8ed1ab_0    conda-forge
     pluggy                    1.3.0              pyhd8ed1ab_0    conda-forge
     pre-commit                3.5.0              pyha770c72_0    conda-forge
     prometheus_client         0.18.0             pyhd8ed1ab_0    conda-forge
     prompt-toolkit            3.0.40             pyha770c72_0    conda-forge
     prompt_toolkit            3.0.40               hd8ed1ab_0    conda-forge
     protobuf                  4.24.4          py310h620c231_0    conda-forge
     psutil                    5.9.5           py310h2372a71_1    conda-forge
     pthread-stubs             0.4               h36c2ea0_1001    conda-forge
     ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
     pure_eval                 0.2.2              pyhd8ed1ab_0    conda-forge
     py-cpuinfo                9.0.0              pyhd8ed1ab_0    conda-forge
     pyarrow                   14.0.1          py310hf9e7431_1_cpu    conda-forge
     pycparser                 2.21               pyhd8ed1ab_0    conda-forge
     pydata-sphinx-theme       0.14.3             pyhd8ed1ab_0    conda-forge
     pygments                  2.16.1             pyhd8ed1ab_0    conda-forge
     pylibcugraph              23.12.0                  pypi_0    pypi
     pylibcugraphops           23.12.00a14     cuda12_py310_231110_g207773d3_14    rapidsai-nightly
     pylibraft                 23.12.00a85     cuda12_py310_231108_g42512f73_85    rapidsai-nightly
     pylibwholegraph           23.12.00a13     cuda12_py310_231109_gc3bd5ef_13    rapidsai-nightly
     pynvml                    11.4.1             pyhd8ed1ab_0    conda-forge
     pyparsing                 3.1.1              pyhd8ed1ab_0    conda-forge
     pysocks                   1.7.1              pyha2e5f31_6    conda-forge
     pytest                    7.4.3              pyhd8ed1ab_0    conda-forge
     pytest-benchmark          4.0.0              pyhd8ed1ab_0    conda-forge
     pytest-cov                4.1.0              pyhd8ed1ab_0    conda-forge
     pytest-mpl                0.16.1             pyhd8ed1ab_0    conda-forge
     pytest-xdist              3.4.0              pyhd8ed1ab_0    conda-forge
     python                    3.10.13         hd12c33a_0_cpython    conda-forge
     python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
     python-fastjsonschema     2.18.1             pyhd8ed1ab_0    conda-forge
     python-json-logger        2.0.7              pyhd8ed1ab_0    conda-forge
     python-louvain            0.16               pyhd8ed1ab_0    conda-forge
     python_abi                3.10                    4_cp310    conda-forge
     pytz                      2023.3.post1       pyhd8ed1ab_0    conda-forge
     pyyaml                    6.0.1           py310h2372a71_1    conda-forge
     pyzmq                     25.1.1          py310h795f18f_2    conda-forge
     raft-dask                 23.12.00a85     cuda12_py310_231108_g42512f73_85    rapidsai-nightly
     rdma-core                 28.9                 h59595ed_1    conda-forge
     re2                       2023.06.02           h2873b5e_0    conda-forge
     readline                  8.2                  h8228510_1    conda-forge
     recommonmark              0.7.1              pyhd8ed1ab_0    conda-forge
     referencing               0.30.2             pyhd8ed1ab_0    conda-forge
     requests                  2.31.0             pyhd8ed1ab_0    conda-forge
     rfc3339-validator         0.1.4              pyhd8ed1ab_0    conda-forge
     rfc3986-validator         0.1.1              pyh9f0ad1d_0    conda-forge
     rhash                     1.4.4                hd590300_0    conda-forge
     rich                      13.6.0             pyhd8ed1ab_0    conda-forge
     rmm                       23.12.00a21     cuda12_py310_231109_gd407fd38_21    rapidsai-nightly
     rpds-py                   0.12.0          py310hcb5633a_0    conda-forge
     s2n                       1.3.56               h06160fa_0    conda-forge
     scikit-build              0.17.6             pyh4af843d_0    conda-forge
     scikit-learn              1.3.2           py310h1fdf081_1    conda-forge
     scipy                     1.11.3          py310hb13e2d6_1    conda-forge
     send2trash                1.8.2              pyh41d4057_0    conda-forge
     setuptools                68.2.2             pyhd8ed1ab_0    conda-forge
     six                       1.16.0             pyh6c4a22f_0    conda-forge
     snappy                    1.1.10               h9fff704_0    conda-forge
     sniffio                   1.3.0              pyhd8ed1ab_0    conda-forge
     snowballstemmer           2.2.0              pyhd8ed1ab_0    conda-forge
     sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
     soupsieve                 2.5                pyhd8ed1ab_1    conda-forge
     spdlog                    1.11.0               h9b3ece8_1    conda-forge
     sphinx                    5.3.0              pyhd8ed1ab_0    conda-forge
     sphinx-copybutton         0.5.2              pyhd8ed1ab_0    conda-forge
     sphinx-markdown-tables    0.0.17             pyh6c4a22f_0    conda-forge
     sphinxcontrib-applehelp   1.0.7              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-devhelp     1.0.5              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-htmlhelp    2.0.4              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-jsmath      1.0.1              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-qthelp      1.0.6              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-serializinghtml 1.1.9              pyhd8ed1ab_0    conda-forge
     sphinxcontrib-websupport  1.2.6              pyhd8ed1ab_0    conda-forge
     stack_data                0.6.2              pyhd8ed1ab_0    conda-forge
     sysroot_linux-64          2.17                h4a8ded7_13    conda-forge
     tblib                     2.0.0              pyhd8ed1ab_0    conda-forge
     terminado                 0.18.0             pyh0d859eb_0    conda-forge
     threadpoolctl             3.2.0              pyha21a80b_0    conda-forge
     tinycss2                  1.2.1              pyhd8ed1ab_0    conda-forge
     tk                        8.6.13          noxft_h4845f30_101    conda-forge
     toml                      0.10.2             pyhd8ed1ab_0    conda-forge
     tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
     toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
     tornado                   6.3.3           py310h2372a71_1    conda-forge
     traitlets                 5.13.0             pyhd8ed1ab_0    conda-forge
     types-python-dateutil     2.8.19.14          pyhd8ed1ab_0    conda-forge
     typing-extensions         4.8.0                hd8ed1ab_0    conda-forge
     typing_extensions         4.8.0              pyha770c72_0    conda-forge
     typing_utils              0.1.0              pyhd8ed1ab_0    conda-forge
     tzdata                    2023c                h71feb2d_0    conda-forge
     ucx                       1.15.0               h195a15c_0    conda-forge
     ucx-proc                  1.0.0                       gpu    rapidsai
     ucx-py                    0.35.00a13      py310_231109_g78c734c_13    rapidsai-nightly
     ukkonen                   1.0.1           py310hd41b1e2_4    conda-forge
     unicodedata2              15.1.0          py310h2372a71_0    conda-forge
     uri-template              1.3.0              pyhd8ed1ab_0    conda-forge
     urllib3                   2.0.7              pyhd8ed1ab_0    conda-forge
     virtualenv                20.24.6            pyhd8ed1ab_0    conda-forge
     wcwidth                   0.2.9              pyhd8ed1ab_0    conda-forge
     webcolors                 1.13               pyhd8ed1ab_0    conda-forge
     webencodings              0.5.1              pyhd8ed1ab_2    conda-forge
     websocket-client          1.6.4              pyhd8ed1ab_0    conda-forge
     wget                      1.20.3               ha35d2d1_1    conda-forge
     wheel                     0.41.3             pyhd8ed1ab_0    conda-forge
     xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
     xorg-libice               1.1.1                hd590300_0    conda-forge
     xorg-libsm                1.2.4                h7391055_0    conda-forge
     xorg-libx11               1.8.7                h8ee46fc_0    conda-forge
     xorg-libxau               1.0.11               hd590300_0    conda-forge
     xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
     xorg-libxext              1.3.4                h0b41bf4_2    conda-forge
     xorg-libxrender           0.9.11               hd590300_0    conda-forge
     xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
     xorg-xextproto            7.3.0             h0b41bf4_1003    conda-forge
     xorg-xproto               7.0.31            h7f98852_1007    conda-forge
     xyzservices               2023.10.1          pyhd8ed1ab_0    conda-forge
     xz                        5.2.6                h166bdaf_0    conda-forge
     yaml                      0.2.5                h7f98852_2    conda-forge
     yarl                      1.9.2           py310h2372a71_1    conda-forge
     zeromq                    4.3.5                h59595ed_0    conda-forge
     zict                      3.0.0              pyhd8ed1ab_0    conda-forge
     zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
     zlib                      1.2.13               hd590300_5    conda-forge
     zstd                      1.5.5                hfc55251_0    conda-forge
     
</pre></details>

Other/Misc.

No response

Code of Conduct

  • I agree to follow cuGraph's Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@huiyuxie huiyuxie added ? - Needs Triage Need team to review and classify bug Something isn't working labels Nov 17, 2023
@huiyuxie huiyuxie changed the title [BUG]: Failed to build from source due to unavailable download links for rapids-dask-dependency [BUG]: Failed to build from source due to unavailable rapids-dask-dependency Nov 17, 2023
@BradReesWork BradReesWork removed the ? - Needs Triage Need team to review and classify label Nov 20, 2023
@rlratzel
Copy link
Contributor

Hi @huiyuxie , I was able to reproduce your problem. The commands in the document you followed are not correct, so I've submitted this PR to update the doc.

The issue is related to the new rapids-dask-dependency currently being a 24.02.00a alpha release, and the setup.py script not using alpha release versions by default and instead trying to download a non-alpha version, which is not available. The build.sh script uses pip install to install packages and passes the appropriate options so it uses the rapids-dask-dependency package already present in the conda environment.

My recommendation is to simply run build.sh --help to see the options available and then run build.sh with the options you need to build the desired components. Please let me know if this helps or if you have problems using build.sh

@rlratzel rlratzel linked a pull request Nov 29, 2023 that will close this issue
@huiyuxie
Copy link
Contributor Author

Thanks for the update @rlratzel !

rapids-bot bot pushed a commit that referenced this issue Nov 29, 2023
closes #4008 

* Removes unsupported `setup.py` calls, which resulted in issue #4008 . The document now describes how to use `build.sh`, which is more consistent with docs for other RAPIDS libs.
* Removes `build.sh` output from docs in favor of documenting how to use `--help` to eliminate the doc being out-of-date with the script.
* Removes extra wording in places and cleans up various sections.

Authors:
  - Rick Ratzel (https://github.com/rlratzel)

Approvers:
  - Don Acosta (https://github.com/acostadon)
  - Brad Rees (https://github.com/BradReesWork)

URL: #4024
@rlratzel
Copy link
Contributor

Thanks for bringing this to our attention. I just merged the PR to fix the docs, so I'll close this now. Please re-open or create another issue if there's still problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants