Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

新版在阿里云克隆后会各种兼容性报错 #587

Open
yuchao532 opened this issue Nov 22, 2024 · 0 comments
Open

新版在阿里云克隆后会各种兼容性报错 #587

yuchao532 opened this issue Nov 22, 2024 · 0 comments

Comments

@yuchao532
Copy link

前几天还是好的,今天新开N个实例,配置了好久各种报错
包括不限于以下错误,
Successfully installed lycoris-lora-2.1.0.post3
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:20-506427 WARNING Package version not found: onnxruntime-gpu
22:37:20-507297 INFO uninstalling wrong onnxruntime version
Installing onnxruntime
Found existing installation: onnxruntime 1.15.0
Uninstalling onnxruntime-1.15.0:
Successfully uninstalled onnxruntime-1.15.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Installing onnxruntime
WARNING: Skipping onnxruntime-gpu as it is not installed.
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:21-362218 INFO installing onnxruntime
Installing onnxruntime
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
DEPRECATION: The HTML index page being used (https://mirrors.cloud.aliyuncs.com/pypi/simple/onnxruntime/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at pypa/pip#10825
Collecting onnxruntime==1.18.1
Downloading https://mirrors.cloud.aliyuncs.com/pypi/packages/04/da/cd671caf4231942c4f68bf0dc1a959303df91dfd0e1d55c556b924d8e68e/onnxruntime-1.18.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 20.3 MB/s eta 0:00:00
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (1.12)
Requirement already satisfied: coloredlogs in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (15.0.1)
Requirement already satisfied: numpy<2.0,>=1.21.6 in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (1.23.5)
Requirement already satisfied: flatbuffers in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (23.5.26)
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (23.1)
Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (3.19.6)
Requirement already satisfied: humanfriendly>=9.1 in /usr/local/lib/python3.10/dist-packages (from coloredlogs->onnxruntime==1.18.1) (10.0)
Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->onnxruntime==1.18.1) (1.3.0)
Installing collected packages: onnxruntime
Successfully installed onnxruntime-1.18.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Installing onnxruntime-gpu
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
DEPRECATION: The HTML index page being used (https://mirrors.cloud.aliyuncs.com/pypi/simple/onnxruntime-gpu/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at pypa/pip#10825
Collecting onnxruntime-gpu==1.18.1
Downloading https://mirrors.cloud.aliyuncs.com/pypi/packages/4d/52/fa9ba5a69cfed82ba1765882f50664b05c26982f55fec6edd1bda700195f/onnxruntime_gpu-1.18.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (200.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 200.8/200.8 MB 7.6 MB/s eta 0:00:00
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (23.1)
Requirement already satisfied: flatbuffers in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (23.5.26)
Requirement already satisfied: numpy<2.0,>=1.21.6 in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (1.23.5)
Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (3.19.6)
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (1.12)
Requirement already satisfied: coloredlogs in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (15.0.1)
Requirement already satisfied: humanfriendly>=9.1 in /usr/local/lib/python3.10/dist-packages (from coloredlogs->onnxruntime-gpu==1.18.1) (10.0)
Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->onnxruntime-gpu==1.18.1) (1.3.0)
Installing collected packages: onnxruntime-gpu
Successfully installed onnxruntime-gpu-1.18.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:40-634133 INFO SD-Trainer Version: v1.10.0-13-gb6d33fe
22:37:40-635090 INFO Starting tageditor...
22:37:40-635965 INFO Starting tensorboard...
22:37:40-656750 INFO Server started at http://127.0.0.1:28000
TensorFlow installation not found - running with reduced feature set.

NOTE: Using experimental fast data loading logic. To disable, pass
"--load_fast=false" and report issues on GitHub. More details:
tensorflow/tensorboard#4784

22:37:41-718554 WARNING tkinter not found, file selector will not work.
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.10/dist-packages/tensorboard/main.py", line 53, in
run_main()
File "/usr/local/lib/python3.10/dist-packages/tensorboard/main.py", line 46, in run_main
app.run(tensorboard.main, flags_parser=tensorboard.configure)
File "/usr/local/lib/python3.10/dist-packages/absl/app.py", line 308, in run
_run_main(main, args)
File "/usr/local/lib/python3.10/dist-packages/absl/app.py", line 254, in _run_main
sys.exit(main(argv))
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 276, in main
return runner(self.flags) or 0
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 292, in _run_serve_subcommand
server = self._make_server()
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 467, in _make_server
app = application.TensorBoardWSGIApp(
File "/usr/local/lib/python3.10/dist-packages/tensorboard/backend/application.py", line 140, in TensorBoardWSGIApp
return TensorBoardWSGI(
File "/usr/local/lib/python3.10/dist-packages/tensorboard/backend/application.py", line 253, in init
raise ValueError(
ValueError: Duplicate plugins for name projector
22:37:41-921897 INFO Loading config from
/mnt/workspace/lora-scripts/assets/config.json
22:37:41-923439 INFO Torch 2.0.1+cu117
22:37:41-942983 WARNING Torch version is lower than 2.3.0, which may not be
able to train FLUX model properly. Please re-run the
installation script (install.ps1 or install.bash) to
upgrade Torch.
22:37:41-944041 WARNING !!!Torch 版本低于 2.3.0,将无法正常训练 FLUX
模型。请考虑重新运行安装脚本以升级 Torch!!!
22:37:41-944870 WARNING !!!若您正在使用训练包,请直接下载最新训练包!!!
22:37:41-952822 INFO Torch backend: nVidia CUDA 11.7 cuDNN 8500
22:37:41-962115 INFO Torch detected GPU: NVIDIA A10 VRAM 22732 Arch (8, 6)
Cores 72 ‘

或者
Successfully installed protobuf-3.19.6 tensorboard-2.10.1 tensorboard-data-server-0.6.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
07:32:20-093176 INFO SD-Trainer Version: v1.10.0-12-g9e89bd2
07:32:20-094845 INFO Starting tageditor...
07:32:20-095947 INFO Starting tensorboard...
07:32:20-132440 INFO Server started at http://127.0.0.1:28000
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1732318340.892683 1257 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1732318340.897006 1257 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
TensorFlow installation not found - running with reduced feature set.
07:32:20-950509 INFO Loading config from /mnt/workspace/lora-scripts/assets/config.json
07:32:20-953171 INFO Torch 2.3.0+cu121

NOTE: Using experimental fast data loading logic. To disable, pass
"--load_fast=false" and report issues on GitHub. More details:
tensorflow/tensorboard#4784

Address already in use
Port 6006 is in use by another program. Either identify and stop that program, or start the server with a different port.
07:32:21-739171 INFO Torch backend: nVidia CUDA 12.1 cuDNN 8902
07:32:21-747974 INFO Torch detected GPU: NVIDIA A10 VRAM 22732 Arch (8, 6) Cores 72
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1732318344.699063 1256 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1732318344.703475 1256 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1603, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/usr/local/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/processing_auto.py", line 28, in
from ...image_processing_utils import ImageProcessingMixin
File "/usr/local/lib/python3.10/site-packages/transformers/image_processing_utils.py", line 21, in
from .image_transforms import center_crop, normalize, rescale
File "/usr/local/lib/python3.10/site-packages/transformers/image_transforms.py", line 49, in
import tensorflow as tf
File "/usr/local/lib/python3.10/site-packages/tensorflow/init.py", line 49, in
from tensorflow._api.v2 import internal
File "/usr/local/lib/python3.10/site-packages/tensorflow/_api/v2/internal/init.py", line 8, in
from tensorflow._api.v2.internal import autograph
File "/usr/local/lib/python3.10/site-packages/tensorflow/_api/v2/internal/autograph/init.py", line 8, in
from tensorflow.python.autograph.core.ag_ctx import control_status_ctx # line: 34
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/core/ag_ctx.py", line 21, in
from tensorflow.python.autograph.utils import ag_logging
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/utils/init.py", line 17, in
from tensorflow.python.autograph.utils.context_managers import control_dependency_on_returns
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/utils/context_managers.py", line 19, in
from tensorflow.python.framework import ops
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/framework/ops.py", line 33, in
from tensorflow.core.framework import attr_value_pb2
File "/usr/local/lib/python3.10/site-packages/tensorflow/core/framework/attr_value_pb2.py", line 5, in
from google.protobuf.internal import builder as _builder
ImportError: cannot import name 'builder' from 'google.protobuf.internal' (/usr/local/lib/python3.10/site-packages/google/protobuf/internal/init.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/launch.py", line 101, in
import interface
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/interface.py", line 17, in
import tab_main, tab_settings, cmd_args, settings, utilities, logger, launch, paths
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/tab_main.py", line 9, in
from dte_instance import dte_instance
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dte_instance.py", line 1, in
import dataset_tag_editor as dte_module
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/init.py", line 1, in
from . import tagger
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/tagger.py", line 6, in
from .interrogators import WaifuDiffusionTagger, DepDanbooruTagger
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/interrogators/init.py", line 3, in
from .git_large_captioning import GITLargeCaptioning
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/interrogators/git_large_captioning.py", line 1, in
from transformers import AutoProcessor, AutoModelForCausalLM
File "", line 1075, in _handle_fromlist
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1594, in getattr
value = getattr(module, name)
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1593, in getattr
module = self._get_module(self._class_to_module[name])
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1605, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.auto.processing_auto because of the following error (look up to see its traceback):
cannot import name 'builder' from 'google.protobuf.internal' (/usr/local/lib/python3.10/site-packages/google/protobuf/internal/init.py)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant