-
Notifications
You must be signed in to change notification settings - Fork 111
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
wandb error in running main_instance_segmentation #160
Comments
I re-installled everything several times, but still I am getting wandb error! Error: Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace. |
I have encountered the same problem. Have you solved it? |
Hi! Hope the following helps: |
Hi! I am getting wandb error while run main_instance_segmentation script. Any suggestion would be appreciated. Thanks!
/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/MinkowskiEngine-0.5.4-py3.10-linux-x86_64.egg/MinkowskiEngine/init.py:36: UserWarning: The environment variable
OMP_NUM_THREADS
not set. MinkowskiEngine will automatically setOMP_NUM_THREADS=16
. If you want to setOMP_NUM_THREADS
manually, please export it on the command line before running a python script. e.g.export OMP_NUM_THREADS=12; python your_program.py
. It is recommended to set it below 24.warnings.warn(
/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/utilities/seed.py:55: UserWarning: No seed found, seed set to 3840629487
rank_zero_warn(f"No seed found, seed set to {seed}")
Global seed set to 3840629487
EXPERIMENT ALREADY EXIST
{'target': 'pytorch_lightning.loggers.WandbLogger', 'project': '${general.project_name}', 'name': '${general.experiment_name}', 'save_dir': '${general.save_dir}', 'entity': 'schult', 'resume': 'allow', 'id': '${general.experiment_name}'}
wandb: Currently logged in as: ntakhtkeshha. Use
wandb login --relogin
to force reloginwandb: ERROR Error while calling W&B API: permission denied (<Response [403]>)
Problem at: /home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/wandb.py 362 experiment
Traceback (most recent call last):
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/utils.py", line 63, in call
return _instantiate_class(type_or_callable, config, *args, **kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 500, in _instantiate_class
return clazz(*args, **final_kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/wandb.py", line 316, in init
_ = self.experiment
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/logger.py", line 54, in experiment
return get_experiment() or DummyExperiment()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/utilities/rank_zero.py", line 32, in wrapped_fn
return fn(*args, **kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/logger.py", line 52, in get_experiment
return fn(self)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/wandb.py", line 362, in experiment
self._experiment = wandb.init(**self._wandb_init)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1164, in init
raise e
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1145, in init
run = wi.init()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 764, in init
raise error
wandb.errors.CommError: It appears that you do not have permission to access the requested resource. Please reach out to the project owner to grant you access. If you have the correct permissions, verify that there are no issues with your networking setup.(Error 403: Forbidden)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 198, in run_and_report
return func()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 347, in
lambda: hydra.run(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/hydra.py", line 107, in run
return run_job(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/core/utils.py", line 128, in run_job
ret.return_value = task_function(task_cfg)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 108, in main
train(cfg)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/main.py", line 27, in decorated_main
return task_function(cfg_passthrough)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 70, in train
cfg, model, loggers = get_parameters(cfg)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 48, in get_parameters
loggers.append(hydra.utils.instantiate(log))
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/utils.py", line 70, in call
raise HydraException(f"Error calling '{cls}' : {e}") from e
hydra.errors.HydraException: Error calling 'pytorch_lightning.loggers.WandbLogger' : It appears that you do not have permission to access the requested resource. Please reach out to the project owner to grant you access. If you have the correct permissions, verify that there are no issues with your networking setup.(Error 403: Forbidden)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 114, in
main()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/main.py", line 32, in decorated_main
_run_hydra(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 346, in _run_hydra
run_and_report(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 267, in run_and_report
print_exception(etype=None, value=ex, tb=final_tb) # type: ignore
TypeError: print_exception() got an unexpected keyword argument 'etype'
Traceback (most recent call last):
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/utils.py", line 63, in call
return _instantiate_class(type_or_callable, config, *args, **kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 500, in _instantiate_class
return clazz(*args, **final_kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/wandb.py", line 316, in init
_ = self.experiment
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/logger.py", line 54, in experiment
return get_experiment() or DummyExperiment()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/utilities/rank_zero.py", line 32, in wrapped_fn
return fn(*args, **kwargs)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/logger.py", line 52, in get_experiment
return fn(self)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/pytorch_lightning/loggers/wandb.py", line 362, in experiment
self._experiment = wandb.init(**self._wandb_init)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1164, in init
raise e
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1145, in init
run = wi.init()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 764, in init
raise error
wandb.errors.CommError: It appears that you do not have permission to access the requested resource. Please reach out to the project owner to grant you access. If you have the correct permissions, verify that there are no issues with your networking setup.(Error 403: Forbidden)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 198, in run_and_report
return func()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 347, in
lambda: hydra.run(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/hydra.py", line 107, in run
return run_job(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/core/utils.py", line 128, in run_job
ret.return_value = task_function(task_cfg)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 108, in main
train(cfg)
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/main.py", line 27, in decorated_main
return task_function(cfg_passthrough)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 70, in train
cfg, model, loggers = get_parameters(cfg)
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 48, in get_parameters
loggers.append(hydra.utils.instantiate(log))
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/utils.py", line 70, in call
raise HydraException(f"Error calling '{cls}' : {e}") from e
hydra.errors.HydraException: Error calling 'pytorch_lightning.loggers.WandbLogger' : It appears that you do not have permission to access the requested resource. Please reach out to the project owner to grant you access. If you have the correct permissions, verify that there are no issues with your networking setup.(Error 403: Forbidden)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/ntakhtke/DL models/Mask3D-main/main_instance_segmentation.py", line 114, in
main()
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/main.py", line 32, in decorated_main
_run_hydra(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 346, in _run_hydra
run_and_report(
File "/home/ntakhtke/anaconda3/envs/mask3d_cuda113/lib/python3.10/site-packages/hydra/_internal/utils.py", line 267, in run_and_report
print_exception(etype=None, value=ex, tb=final_tb) # type: ignore
TypeError: print_exception() got an unexpected keyword argument 'etype'
The text was updated successfully, but these errors were encountered: