Requirements could not deploy on Python3.10 #40
Comments
|
Our current version of Python 3.10.0. Hence i changed some requirement.txt and updated accordingly. We will post if we find any issues.. dvc==2.8.3 |
|
Installing collected packages: webencodings, wcwidth, voluptuous, text-unidecode, Send2Trash, pywin32, pytz, python-fsutil, pygtrie, pyasn1, pure-eval, |
|
After i could deploy all required modules and trying to run the "step-1-organize-ml-project.ipynb" and it through the following message import itertools import joblib import json import matplotlib.pyplot as plt import numpy as np import pandas as pd from sklearn.metrics import confusion_matrix, f1_score from sklearn.linear_model import LogisticRegression from sklearn.model_selection import train_test_split ModuleNotFoundError Traceback (most recent call last) ModuleNotFoundError: No module named 'joblib' In-fact, i also checked respective joblib is exist in environment. |
|
Hi @raviseerapu, I think you're notebook is not using |
|
I use Python 3.11.6 on Mac: joblib==1.2.0
matplotlib==3.9.0
numpy==1.23.5
pandas==2.2.2
pytest==6.2.4
python-box==5.4.1
pyyaml==6.0.1
scikit-learn==1.4.2
scipy==1.13.0
tqdm==4.63.1
dvc==3.50.2
dvc-s3==3.2.0
pygit2==1.14.1Add these line before "from src..." in every files inside src/stages: import sys
sys.path.append('./')and make sure you run comand in root repo dir |
@Team,
Trying to deploy requirements on Python3.10 version. Please let us know, is this specific specific python version have to deploy and test myself this code.
(dvc-venv) PS C:\Jan5-2021\DVC\course-ds-base> pip install -r .\requirements.txt
Collecting dvc==2.8.3
Downloading dvc-2.8.3-py3-none-any.whl (399 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 399.3/399.3 kB 2.3 MB/s eta 0:00:00
Collecting joblib==1.0.1
Downloading joblib-1.0.1-py3-none-any.whl (303 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 303.1/303.1 kB 6.2 MB/s eta 0:00:00
Collecting jupyter==1.0.0
Using cached jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB)
Collecting jupyter_contrib_nbextensions==0.5.1
Downloading jupyter_contrib_nbextensions-0.5.1-py2.py3-none-any.whl (20.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.9/20.9 MB 1.3 MB/s eta 0:00:00
Collecting matplotlib==3.4.3
Downloading matplotlib-3.4.3.tar.gz (37.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37.9/37.9 MB 1.3 MB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Collecting numpy==1.21.2
Downloading numpy-1.21.2.zip (10.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.3/10.3 MB 1.6 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting pandas==1.3.2
Downloading pandas-1.3.2.tar.gz (4.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 4.6 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [297 lines of output]
Ignoring numpy: markers 'python_version == "3.7" and (platform_machine != "arm64" or platform_system != "Darwin") and platform_machine != "aarch64
"' don't match your environment
Ignoring numpy: markers 'python_version == "3.8" and (platform_machine != "arm64" or platform_system != "Darwin") and platform_machine != "aarch64
"' don't match your environment
Ignoring numpy: markers 'python_version == "3.7" and platform_machine == "aarch64"' don't match your environment
Ignoring numpy: markers 'python_version == "3.8" and platform_machine == "aarch64"' don't match your environment
Ignoring numpy: markers 'python_version == "3.8" and platform_machine == "arm64" and platform_system == "Darwin"' don't match your environment
Ignoring numpy: markers 'python_version == "3.9" and platform_machine == "arm64" and platform_system == "Darwin"' don't match your environment
Collecting setuptools>=51.0.0
Using cached setuptools-65.5.0-py3-none-any.whl (1.2 MB)
Collecting wheel
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Collecting Cython<3,>=0.29.21
Using cached Cython-0.29.32-py2.py3-none-any.whl (986 kB)
Collecting numpy==1.19.3
Downloading numpy-1.19.3.zip (7.3 MB)
---------------------------------------- 7.3/7.3 MB 485.5 kB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
:
Optimized (vendor) Blas libraries are not found.
Falls back to netlib Blas library which has worse performance.
A better performance should be easily gained by switching
Blas library.
if self._calc_info(blas):
blas_info:
libraries blas not found in ['C:\Jan5-2021\DVC\course-ds-base\dvc-venv\lib', 'C:\']
NOT AVAILABLE
:
Blas (http://www.netlib.org/blas/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [blas]) or by setting
the BLAS environment variable.
if self._calc_info(blas):
blas_src_info:
NOT AVAILABLE
:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
if self._calc_info(blas):
NOT AVAILABLE
:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
return getattr(self, 'calc_info{}'.format(name))()
lapack_src_info:
NOT AVAILABLE
:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
return getattr(self, 'calc_info{}'.format(name))()
NOT AVAILABLE
tribution option: 'define_macros'
warnings.warn(msg)
running dist_info
running build_src
build_src
building py_modules sources
creating build
creating build\src.win-amd64-3.10
creating build\src.win-amd64-3.10\numpy
creating build\src.win-amd64-3.10\numpy\distutils
building library "npymath" sources
Traceback (most recent call last):
File "C:\Jan5-2021\DVC\course-ds-base\dvc-venv\Lib\site-packages\pip_vendor\pep517\in_process_in_process.py", line 351, in
main()
File "C:\Jan5-2021\DVC\course-ds-base\dvc-venv\Lib\site-packages\pip_vendor\pep517\in_process_in_process.py", line 333, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "C:\Jan5-2021\DVC\course-ds-base\dvc-venv\Lib\site-packages\pip_vendor\pep517\in_process_in_process.py", line 152, in prepare_metadata_
for_build_wheel
return hook(metadata_directory, config_settings)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools\build_meta.py", line 157, in prepare_met
adata_for_build_wheel
self.run_setup()
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools\build_meta.py", line 248, in run_setup
super(BuildMetaLegacyBackend,
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools\build_meta.py", line 142, in run_setup
exec(compile(code, file, 'exec'), locals())
File "setup.py", line 508, in
setup_package()
File "setup.py", line 500, in setup_package
setup(**metadata)
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\core.py", line 169, in s
etup
return old_setup(**new_attr)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_init.py", line 165, in setup
return distutils.core.setup(**attrs)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\core.py", line 148, in setup
dist.run_commands()
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\dist.py", line 967, in run_co
mmands
self.run_command(cmd)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\dist.py", line 986, in run_co
mmand
cmd_obj.run()
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools\command\dist_info.py", line 31, in run
egg_info.run()
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\egg_info.py", li
ne 24, in run
self.run_command("build_src")
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\cmd.py", line 313, in run_com
mand
self.distribution.run_command(command)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\dist.py", line 986, in run_co
mmand
cmd_obj.run()
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\build_src.py", l
ine 144, in run
self.build_sources()
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\build_src.py", l
ine 155, in build_sources
self.build_library_sources(libname_info)
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\build_src.py", l
ine 288, in build_library_sources
sources = self.generate_sources(sources, (lib_name, build_info))
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\build_src.py", l
ine 378, in generate_sources
source = func(extension, build_dir)
File "numpy\core\setup.py", line 658, in get_mathlib_info
st = config_cmd.try_link('int main(void) { return 0;}')
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\command\config.py", line 243,
in try_link
self._link(body, headers, include_dirs,
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\config.py", line
162, in _link
return self._wrap_method(old_config._link, lang,
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\config.py", line
96, in _wrap_method
ret = mth(((self,)+args))
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\command\config.py", line 137,
in _link
(src, obj) = self._compile(body, headers, include_dirs, lang)
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\config.py", line
105, in _compile
src, obj = self._wrap_method(old_config._compile, lang,
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\command\config.py", line
96, in _wrap_method
ret = mth(*((self,)+args))
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils\command\config.py", line 132,
in _compile
self.compiler.compile([src], include_dirs=include_dirs)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils_msvccompiler.py", line 401,
in compile
self.spawn(args)
File "C:\Users\seerapu\AppData\Local\Temp\pip-build-env-r0sar12d\overlay\Lib\site-packages\setuptools_distutils_msvccompiler.py", line 505,
in spawn
return super().spawn(cmd, env=env)
File "C:\Users\seerapu\AppData\Local\Temp\pip-install-jsn8okah\numpy_c87dffe387db45458072f04c8df762c4\numpy\distutils\ccompiler.py", line 90,
in
m = lambda self, *args, **kw: func(self, *args, **kw)
TypeError: CCompiler_spawn() got an unexpected keyword argument 'env'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
The text was updated successfully, but these errors were encountered: