import apex always have AttributeError: module 'torch' has no attribute 'library'

[Cominder]

always have
Traceback (most recent call last):
File "", line 1, in
File "/root/apex/apex/init.py", line 26, in
from . import normalization
File "/root/apex/apex/normalization/init.py", line 1, in
from .fused_layer_norm import FusedLayerNorm, MixedFusedLayerNorm, FusedRMSNorm, MixedFusedRMSNorm
File "/root/apex/apex/normalization/fused_layer_norm.py", line 70, in
if supports_custom_op():
File "/root/apex/apex/normalization/fused_layer_norm.py", line 18, in supports_custom_op
return hasattr(torch.library, "custom_op")
AttributeError: module 'torch' has no attribute 'library'。

no matter cuda10.1+torch1.6.0/1.7.1 python3.7 or cuda11.1+torch1.8.0 python3.8 or cuda11.3+torch1.10.1 python3.8, apex did nnot work!

[GG0614]

Did you solve it?

[Cominder]

Did you solve it?  你解决了吗？

NO, still bothers me

[GG0614]

Did you solve it?  你解决了吗？

NO, still bothers me

you can try apex-22.02-parallel-state,I solve this problem just now
cuda11.3+torch1.10.1+torchvision0.11.2+torchaudio0.10.1

[Cominder]

Did you solve it?  你解决了吗？

NO, still bothers me  不，仍然困扰着我

you can try apex-22.02-parallel-state,I solve this problem just now你可以试试apex-22.02-parallel-state，我刚刚解决了这个问题 cuda11.3+torch1.10.1+torchvision0.11.2+torchaudio0.10.1

where to get apex-22.02-parallel-state? I can not find it. and python version? no 22.02

[Cominder]

git clone https://github.com/NVIDIA/apex.git
cd apex
git tag # if not wanted version
git branch -r
git checkout origin/22.02-parallel-state # or another vesion
python setup.py install --cuda_ext --cpp_ext
pip3 install -v --no-cache-dir ./

[GG0614]

git clone https://github.com/NVIDIA/apex.git cd apex git tag # if not wanted version git branch -r git checkout origin/22.02-parallel-state # or another vesion python setup.py install --cuda_ext --cpp_ext pip3 install -v --no-cache-dir ./

yes,you can try

[Malloy99]

git clone https://github.com/NVIDIA/apex.git cd apex git tag # if not wanted version git branch -r git checkout origin/22.02-parallel-state # or another vesion python setup.py install --cuda_ext --cpp_ext pip3 install -v --no-cache-dir ./

Thanks for your answer, I have solved it.

cuda11.3+torch1.10.1+torchvision0.11.2+torchaudio0.10.1

[QLYYLQ]

git clone https://github.com/NVIDIA/apex.git cd apex git tag # if not wanted version git branch -r git checkout origin/22.02-parallel-state # or another vesion python setup.py install --cuda_ext --cpp_ext pip3 install -v --no-cache-dir ./

It works in cuda 11.3, thank you a lot

[rzw520]

我用这个版本成功解决了
git clone https://github.com/ptrblck/apex.git
cd apex
git checkout apex_no_distributed
pip install -v --no-cache-dir ./