Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training Problem #33

Open
13678066760 opened this issue Jul 18, 2024 · 0 comments
Open

Training Problem #33

13678066760 opened this issue Jul 18, 2024 · 0 comments

Comments

@13678066760
Copy link

Hi, nice work! When I was in traing process, I came across a problem with dockerpycreds, here's the log. :
Traceback (most recent call last):
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/main.py", line 1, in
from wandb.cli import cli
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/cli/cli.py", line 2151, in
default=find_executable("nvidia-docker") is not None,
File "/home/adsec/.local/lib/python3.8/site-packages/dockerpycreds/utils.py", line 12, in find_executable
return distutils.spawn.find_executable(executable, path)
AttributeError: module 'distutils' has no attribute 'spawn'
Traceback (most recent call last):
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/bin/sgn-train", line 8, in
sys.exit(entrypoint())
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 262, in entrypoint
main(
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 247, in main
launch(
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 189, in launch
main_func(local_rank=0, world_size=world_size, config=config)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 99, in train_loop
trainer.setup()
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/engine/trainer.py", line 204, in setup
writer.setup_event_writer(
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/decorators.py", line 82, in wrapper
ret = func(*args, **kwargs)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/writer.py", line 223, in setup_event_writer
curr_writer = WandbWriter(log_dir=log_dir, experiment_name=experiment_name, project_name=project_name)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/writer.py", line 310, in init
wandb.init(
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_init.py", line 1195, in init
wandb._sentry.reraise(e)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/analytics/sentry.py", line 155, in reraise
raise exc.with_traceback(sys.exc_info()[2])
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_init.py", line 1180, in init
wi.setup(kwargs)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_init.py", line 189, in setup
self._wl = wandb_setup.setup(settings=setup_settings)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 325, in setup
ret = _setup(settings=settings)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 318, in _setup
wl = _WandbSetup(settings=settings)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 303, in init
_WandbSetup._instance = _WandbSetup__WandbSetup(settings=settings, pid=pid)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 114, in init
self._setup()
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 250, in _setup
self._setup_manager()
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_setup.py", line 283, in _setup_manager
self._manager = wandb_manager._Manager(settings=self._settings)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/wandb_manager.py", line 141, in init
self._service.start()
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/service/service.py", line 253, in start
self._launch_server()
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/service/service.py", line 247, in _launch_server
_sentry.reraise(e)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/analytics/sentry.py", line 155, in reraise
raise exc.with_traceback(sys.exc_info()[2])
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/service/service.py", line 245, in _launch_server
self._wait_for_ports(fname, proc=internal_proc)
File "/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/wandb/sdk/service/service.py", line 109, in _wait_for_ports
raise ServiceStartProcessError(
wandb.sdk.service.service.ServiceStartProcessError: The wandb service process exited with 1. Ensure that sys.executable is a valid python interpreter. You can override it with the _executable setting or with the WANDB__EXECUTABLE environment variable.
{'command': ['/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/bin/python', '-m', 'wandb', 'service', '--debug', '--port-filename', '/tmp/tmppbt0yuji/port-1346013.txt', '--pid', '1346013', '--serve-sock'], 'sys_executable': '/home/adsec/anaconda/anaconda3/envs/street-gaussians-ns/bin/python', 'which_python': '/ho(stree(st(street-g(stree(stree(stree(stree(st(st(st(street-gaussians-ns)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant