Multi-backend refactor: Alpha release ( AMD ROCm ONLY ) #1339
Titus-von-Koeller
started this conversation in
Refactorings
Replies: 8 comments 1 reply
-
|
Trying to install on ubuntu 22.06 rocm 6.1.2 and I can't pass the compilation with the following error: -- Configuring bitsandbytes (Backend: hip) CMake Error at /opt/rocm/lib/cmake/hip-lang/hip-lang-config.cmake:126 (message): |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I have been using InvokeAI (version 5 now 😸). Installing the (on archlinux, rocm v6.2.1) |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I have tried 5.7 python packages with rocm 6.0.2 official archlinux build - bitsandbytes failed followed AMD ROCM site instructions and checked out mutli-backend-refactor Why does it think rocm version as cuda version and HSA as compute capability isnt it confusing code. I have checked version checking init.py , it struggled finding tag and versioning for a while and then I have checked out latest commit and it somehow managed. Could you help me out please ? I want to be able to use 8 Bit and 4 Bit Quantization function. pip packages: Pacman packages: |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I recently came across this, not sure if it is helpful: https://github.com/ROCm/bitsandbytes |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
the command from the documentation: git clone --depth 1 -b multi-backend-refactor https://github.com/bitsandbytes-foundation/bitsandbytes.git && cd bitsandbytes/Generates this problem: Using the command: git clone -b multi-backend-refactor https://github.com/bitsandbytes-foundation/bitsandbytes.git && cd bitsandbytes/I can run the build. These are the commands I used for compilation:python3.11 -m venv venv
source venv/bin/activate
# torch 2.4.1
pip3 install torch --index-url https://download.pytorch.org/whl/rocm6.1
pip install -r requirements-dev.txt
cmake -DBNB_ROCM_ARCH="gfx1100" -DCOMPUTE_BACKEND=hip -S .
make -j16
pip install -e .python -m bitsandbytes:rocminfo |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
apparently the only problem I've found has been with ROCM_PATH which doesn't seem to respect the use of update-alternatives when there is more than one installation of rocm. I believe it should respect this, since installing multiple versions of rocm is something supported by amd. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I have tried lots of version on torch bitsandbytes and rocm on arch linux ,
at best it works partially and crashes a lot , torch 5.7 rocm 6.02 and
thiis repo was sbest but still disfunctional.
…On Wed, Nov 27, 2024, 15:50 Leonardo Sidney da Silva < ***@***.***> wrote:
apparently the only problem I've found has been with ROCM_PATH which
doesn't seem to respect the use of update-alternatives when there is more
than one installation of rocm. I believe it should respect this, since
installing multiple versions of rocm is something supported by amd.
In this case I'm using Ubuntu 22.04 to compile the source code according
to the specifications of how it was tested (although I mentioned above that
I use Arch Linux xD)
—
Reply to this email directly, view it on GitHub
<#1339 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEB5YX4ZNTJWBP3NJWWQTQT2CW5YRAVCNFSM6AAAAABNKWKM4OVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCMZZGQ2DANQ>
.
You are receiving this because you commented.Message ID:
<bitsandbytes-foundation/bitsandbytes/repo-discussions/1339/comments/11394406
@github.com>
|
Beta Was this translation helpful? Give feedback.
1 reply
-
|
You can try this package on Arch Linux. opencl-amd. |
Beta Was this translation helpful? Give feedback.
-
|
I have tried this but my card is 7600 XT so its no go for me
Gediz GÜRSU
…On Wed, 27 Nov 2024 at 21:55, Leonardo Sidney da Silva < ***@***.***> wrote:
You can try this package on Arch Linux. opencl-amd
<https://aur.archlinux.org/cgit/aur.git/commit/?h=opencl-amd&id=b9d50154b37858f363bdd83ef781891042440daa>
.
When using Arch Linux and bitsandbites for my 7900XTX the best use I found
was this package(remember to install opencl-amd-dev) in version 6.1.3 with
torch6.1(pip3 install torch torchvision torchaudio --index-url
https://download.pytorch.org/whl/rocm6.1) and the multi-backend-refactor
branch of bitsandbytes following the compilation instructions.
—
Reply to this email directly, view it on GitHub
<#1339 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEB5YX6INOD675ENCDLIBOL2CYITHAVCNFSM6AAAAABNKWKM4OVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCMZZHAZDOOA>
.
You are receiving this because you commented.Message ID:
<bitsandbytes-foundation/bitsandbytes/repo-discussions/1339/comments/11398278
@github.com>
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This space is intended to receive feedback from users that are willing to help us by alpha testing the current implementation of the AMD ROCm backend.
Issues to discuss could be
Thanks everyone for you kind support and please remember to have a constructive tone 🤗
Beta Was this translation helpful? Give feedback.
All reactions