Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[staging-next] python3Packages.protobuf: fix drv version #194111

Merged
merged 3 commits into from
Nov 8, 2022

Conversation

oxalica
Copy link
Contributor

@oxalica oxalica commented Oct 2, 2022

TL;DR: Currently the python3Packages.protobuf.version is 3.21 but its output is actually 4.21, which cause suspicious breakages. This PR targets staging-next for the fix.

EDIT: I give up pinning it back to 3.20. Now I did the reverse: just correct version to 4.21 and fix build failure of dependent packages by unrestrict the protobuf requirement. This should be fine according to #194112 (comment)


OLD ATTEMPT:

protobuf 3.21 coresponds with its python library 4.21, which diverges and causes many breakages. protobuf 3.20 is also the last version having the same version as its python library.

See: https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates

Fixes #193997 and tested electrum.

Note that this will also break some packages requiring protobuf >= 4, like biliass. But using 4 breaks
touch (pytorch/pytorch#78362), electrum (spesmilo/electrum#7833), keepkey (keepkey/python-keepkey#146) and any packages containing a legacy generated _pb2.py.
I think pinning to 3.20 would cause less harm.

I'm still running nixpkgs-review to see how it goes.

Description of changes
Things done
  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 22.11 Release Notes (or backporting 22.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
    • (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes
  • Fits CONTRIBUTING.md.

@oxalica oxalica changed the base branch from master to staging-next October 4, 2022 01:37
@oxalica oxalica force-pushed the fix/python-protobuf branch from 846ce88 to 582361a Compare October 4, 2022 01:37
@oxalica oxalica changed the title python3Packages.protobuf: pin to 3.20 [staging-next] python3Packages.protobuf: pin to 3.20 Oct 4, 2022
@bobby285271 bobby285271 added the 12.approvals: 1 This PR was reviewed and approved by one reputable person label Oct 4, 2022
@FRidh
Copy link
Member

FRidh commented Oct 6, 2022

I'm still running nixpkgs-review to see how it goes.

Any update?

@oxalica
Copy link
Contributor Author

oxalica commented Oct 6, 2022

I'm still running nixpkgs-review to see how it goes.

Any update?

My PC seems not capable of handling some large python packges. They require too much memory. 😢
Anyone could help?

@oxalica oxalica force-pushed the fix/python-protobuf branch from 582361a to 9e01549 Compare October 6, 2022 12:17
@erdnaxe
Copy link
Member

erdnaxe commented Oct 6, 2022

I tried running nixpkgs-review on this pull request, but I am also running out of memory (16GB seems not enough).
From what I was able to build before the OOM killer came:

  • y78f3hixj2banpcm0knq503qi6s7nll7-python3.10-marshmallow-dataclass-8.5.8.drv and 85irq998pzw4c5gq9x875c7kgkd052aa-python3.9-marshmallow-dataclass-8.5.8.drv failed to build with exit code 1:
Logs
[...]
Executing setuptoolsBuildPhase
running bdist_wheel
running build
running build_py
creating build
creating build/lib
creating build/lib/marshmallow_dataclass
copying marshmallow_dataclass/typing.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/union_field.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/lazy_class_attribute.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/__init__.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/mypy.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/collection_field.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/py.typed -> build/lib/marshmallow_dataclass
/nix/store/pvj5zdmjn9x150p9knf192k4jqzb9jcy-python3.10-setuptools-65.3.0/lib/python3.10/site-packages/setuptools/command/install.py:34:>
  warnings.warn(
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/typing.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/union_field.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/py.typed -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/lazy_class_attribute.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/__init__.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/mypy.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/collection_field.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
running install_egg_info
running egg_info
creating marshmallow_dataclass.egg-info
writing marshmallow_dataclass.egg-info/PKG-INFO
writing dependency_links to marshmallow_dataclass.egg-info/dependency_links.txt
writing requirements to marshmallow_dataclass.egg-info/requires.txt
writing top-level names to marshmallow_dataclass.egg-info/top_level.txt
writing manifest file 'marshmallow_dataclass.egg-info/SOURCES.txt'
reading manifest file 'marshmallow_dataclass.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
...skipping...
        validator_b = SimpleValidator()
        validator_c = SimpleValidator()
        validator_d = SimpleValidator()

        CustomTypeOneValidator = NewType(
            "CustomTypeOneValidator", str, validate=validator_a
        )
        CustomTypeNoneValidator = NewType("CustomTypeNoneValidator", str, validate=None)
        CustomTypeMultiValidator = NewType(
            "CustomTypeNoneValidator", str, validate=[validator_a, validator_b]
        )

        @dataclasses.dataclass
        class A:
            data: CustomTypeNoneValidator = dataclasses.field()

>       schema_a = class_schema(A)()

tests/test_class_schema.py:319:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
marshmallow_dataclass/__init__.py:356: in class_schema
    return _internal_class_schema(clazz, base_schema, clazz_frame)
marshmallow_dataclass/__init__.py:402: in _internal_class_schema
    attributes.update(
marshmallow_dataclass/__init__.py:405: in <genexpr>
    field_for_schema(
marshmallow_dataclass/__init__.py:729: in field_for_schema
    or _internal_class_schema(typ, base_schema, typ_frame)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

clazz = <function NewType.<locals>.new_type at 0x7ffff6181c60>
base_schema = None
clazz_frame = <frame at 0x8e4260, file '/build/source/tests/test_class_schema.py', line 319, code test_validator_stacking>

    @lru_cache(maxsize=MAX_CLASS_SCHEMA_CACHE_SIZE)
    def _internal_class_schema(
        clazz: type,
        base_schema: Optional[Type[marshmallow.Schema]] = None,
        clazz_frame: types.FrameType = None,
    ) -> Type[marshmallow.Schema]:
        _RECURSION_GUARD.seen_classes[clazz] = clazz.__name__
        try:
            # noinspection PyDataclass
            fields: Tuple[dataclasses.Field, ...] = dataclasses.fields(clazz)
        except TypeError:  # Not a dataclass
            try:
                warnings.warn(
                    "****** WARNING ****** "
                    f"marshmallow_dataclass was called on the class {clazz}, which is not a dataclass. "
                    "It is going to try and convert the class into a dataclass, which may have "
                    "undesirable side effects. To avoid this message, make sure all your classes and "
                    "all the classes of their fields are either explicitly supported by "
                    "marshmallow_dataclass, or define the schema explicitly using "
                    "field(metadata=dict(marshmallow_field=...)). For more information, see "
                    "https://github.com/lovasoa/marshmallow_dataclass/issues/51 "
                    "****** WARNING ******"
                )
                created_dataclass: type = dataclasses.dataclass(clazz)
                return _internal_class_schema(created_dataclass, base_schema, clazz_frame)
            except Exception:
>               raise TypeError(
                    f"{getattr(clazz, '__name__', repr(clazz))} is not a dataclass and cannot be turned into one."
                )
E               TypeError: CustomTypeNoneValidator is not a dataclass and cannot be turned into one.

marshmallow_dataclass/__init__.py:387: TypeError
=========================== short test summary info ============================
FAILED tests/test_class_schema.py::TestClassSchema::test_validator_stacking
================== 1 failed, 89 passed, 1 deselected in 2.44s ==================
...skipping...
        validator_b = SimpleValidator()
        validator_c = SimpleValidator()
        validator_d = SimpleValidator()

        CustomTypeOneValidator = NewType(
            "CustomTypeOneValidator", str, validate=validator_a
        )
        CustomTypeNoneValidator = NewType("CustomTypeNoneValidator", str, validate=None)
        CustomTypeMultiValidator = NewType(
            "CustomTypeNoneValidator", str, validate=[validator_a, validator_b]
        )

        @dataclasses.dataclass
        class A:
            data: CustomTypeNoneValidator = dataclasses.field()

>       schema_a = class_schema(A)()

tests/test_class_schema.py:319:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
marshmallow_dataclass/__init__.py:356: in class_schema
    return _internal_class_schema(clazz, base_schema, clazz_frame)
marshmallow_dataclass/__init__.py:402: in _internal_class_schema
    attributes.update(
marshmallow_dataclass/__init__.py:405: in <genexpr>
    field_for_schema(
marshmallow_dataclass/__init__.py:729: in field_for_schema
    or _internal_class_schema(typ, base_schema, typ_frame)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

clazz = <function NewType.<locals>.new_type at 0x7ffff6181c60>
base_schema = None
clazz_frame = <frame at 0x8e4260, file '/build/source/tests/test_class_schema.py', line 319, code test_validator_stacking>

    @lru_cache(maxsize=MAX_CLASS_SCHEMA_CACHE_SIZE)
    def _internal_class_schema(
        clazz: type,
        base_schema: Optional[Type[marshmallow.Schema]] = None,
        clazz_frame: types.FrameType = None,
    ) -> Type[marshmallow.Schema]:
        _RECURSION_GUARD.seen_classes[clazz] = clazz.__name__
        try:
            # noinspection PyDataclass
            fields: Tuple[dataclasses.Field, ...] = dataclasses.fields(clazz)
        except TypeError:  # Not a dataclass
            try:
                warnings.warn(
                    "****** WARNING ****** "
                    f"marshmallow_dataclass was called on the class {clazz}, which is not a dataclass. "
                    "It is going to try and convert the class into a dataclass, which may have "
                    "undesirable side effects. To avoid this message, make sure all your classes and "
                    "all the classes of their fields are either explicitly supported by "
                    "marshmallow_dataclass, or define the schema explicitly using "
                    "field(metadata=dict(marshmallow_field=...)). For more information, see "
                    "https://github.com/lovasoa/marshmallow_dataclass/issues/51 "
                    "****** WARNING ******"
                )
                created_dataclass: type = dataclasses.dataclass(clazz)
                return _internal_class_schema(created_dataclass, base_schema, clazz_frame)
            except Exception:
>               raise TypeError(
                    f"{getattr(clazz, '__name__', repr(clazz))} is not a dataclass and cannot be turned into one."
                )
E               TypeError: CustomTypeNoneValidator is not a dataclass and cannot be turned into one.

marshmallow_dataclass/__init__.py:387: TypeError
=========================== short test summary info ============================
FAILED tests/test_class_schema.py::TestClassSchema::test_validator_stacking
================== 1 failed, 89 passed, 1 deselected in 2.44s ==================
  • 29vg1dnvqfifr0irnsvnxriqjffdw31m-python3.10-biliass-1.3.5.drv failed with exit code 1:
Logs
[...]
adding 'tests/test_protobuf.py'
adding 'tests/test_xml.py'
adding 'biliass-1.3.5.dist-info/LICENSE'
adding 'biliass-1.3.5.dist-info/METADATA'
adding 'biliass-1.3.5.dist-info/WHEEL'
adding 'biliass-1.3.5.dist-info/entry_points.txt'
adding 'biliass-1.3.5.dist-info/top_level.txt'
adding 'biliass-1.3.5.dist-info/zip-safe'
adding 'biliass-1.3.5.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Finished executing setuptoolsBuildPhase
@nix { "action": "setPhase", "phase": "installPhase" }
installing
Executing pipInstallPhase
/build/biliass-1.3.5/dist /build/biliass-1.3.5
Processing ./biliass-1.3.5-py3-none-any.whl
ERROR: Could not find a version that satisfies the requirement protobuf>=4.21.0 (from biliass) (from versions: none)
ERROR: No matching distribution found for protobuf>=4.21.0

@oxalica
Copy link
Contributor Author

oxalica commented Oct 6, 2022

I met some other dependency requirement failure. 🤔 Maybe it's better to keep both python libs instead?

@NickCao
Copy link
Member

NickCao commented Oct 6, 2022

Result of nixpkgs-review pr 194111 run on x86_64-linux 1

214 packages marked as broken and skipped:
  • barman
  • baserow
  • beancount
  • dbx
  • dvc-with-remotes
  • fava
  • gam
  • git-annex-remote-googledrive
  • gphotos-sync
  • gpt2tc
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • kube-hunter
  • ledger2beancount
  • libtensorflow
  • mlflow-server
  • openai
  • openai-whisper
  • parsedmarc
  • privacyidea
  • python310Packages.arviz
  • python310Packages.baselines
  • python310Packages.beancount
  • python310Packages.beancount_docverif
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cntk
  • python310Packages.coqui-trainer
  • python310Packages.dalle-mini
  • python310Packages.deepwave
  • python310Packages.distrax
  • python310Packages.django-storages
  • python310Packages.dm-sonnet
  • python310Packages.drivelib
  • python310Packages.edward
  • python310Packages.elegy
  • python310Packages.ezyrb
  • python310Packages.ffcv
  • python310Packages.flax
  • python310Packages.functorch
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-nest-sdm
  • python310Packages.gpt-2-simple
  • python310Packages.gspread
  • python310Packages.ignite
  • python310Packages.kubernetes
  • python310Packages.mask-rcnn
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.openai
  • python310Packages.openai-whisper
  • python310Packages.openshift
  • python310Packages.optuna
  • python310Packages.parsedmarc
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.pydmd
  • python310Packages.pymanopt
  • python310Packages.pymc
  • python310Packages.pyro-ppl
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rising
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.scikit-tda
  • python310Packages.shap
  • python310Packages.skorch
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.spacy
  • python310Packages.spacy-loggers
  • python310Packages.spacy-transformers
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-bin
  • python310Packages.tensorflow-build
  • python310Packages.tensorflow-datasets
  • python310Packages.tensorflow-probability
  • python310Packages.tensorflowWithCuda
  • python310Packages.tensorflowWithoutCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchWithCuda
  • python310Packages.torchWithoutCuda
  • python310Packages.torchgpipe
  • python310Packages.torchinfo
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.treex
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.vqgan-jax
  • python310Packages.wandb
  • python310Packages.worldengine
  • python310Packages.zcs
  • python39Packages.arviz
  • python39Packages.baselines
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.cirq
  • python39Packages.cntk
  • python39Packages.coqui-trainer
  • python39Packages.dalle-mini
  • python39Packages.deepwave
  • python39Packages.distrax
  • python39Packages.django-storages
  • python39Packages.dm-sonnet
  • python39Packages.drivelib
  • python39Packages.edward
  • python39Packages.elegy
  • python39Packages.ezyrb
  • python39Packages.ffcv
  • python39Packages.flax
  • python39Packages.functorch
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-nest-sdm
  • python39Packages.gpt-2-simple
  • python39Packages.gspread
  • python39Packages.ignite
  • python39Packages.kubernetes
  • python39Packages.mask-rcnn
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.openai
  • python39Packages.openai-whisper
  • python39Packages.openshift
  • python39Packages.optuna
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.pot
  • python39Packages.pydmd
  • python39Packages.pymanopt
  • python39Packages.pymc
  • python39Packages.pyro-ppl
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rising
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.skorch
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.spacy
  • python39Packages.spacy-loggers
  • python39Packages.spacy-transformers
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboardx
  • python39Packages.tensorflow
  • python39Packages.tensorflow-bin
  • python39Packages.tensorflow-build
  • python39Packages.tensorflow-datasets
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflowWithCuda
  • python39Packages.tensorflowWithoutCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchWithCuda
  • python39Packages.torchWithoutCuda
  • python39Packages.torchgpipe
  • python39Packages.torchinfo
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.treex
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.vqgan-jax
  • python39Packages.wandb
  • python39Packages.worldengine
  • python39Packages.zcs
  • s3ql
  • snakemake
  • tandoor-recipes
  • tts
  • worldengine-cli
33 packages failed to build:
  • biliass (python310Packages.biliass)
  • electrum-grs
  • esphome
  • manim
  • nrfutil
  • or-tools
  • pynitrokey
  • python310Packages.cairo-lang
  • python310Packages.certbot-dns-google
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-logging
  • python310Packages.ibis-framework
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.ortools
  • python310Packages.sagemaker
  • python310Packages.skl2onnx
  • yutto (python310Packages.yutto)
  • python39Packages.apache-beam
  • python39Packages.biliass
  • python39Packages.cairo-lang
  • python39Packages.certbot-dns-google
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-logging
  • python39Packages.ibis-framework
  • python39Packages.manticore
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.ortools
  • python39Packages.sagemaker
  • python39Packages.skl2onnx
  • python39Packages.yutto
  • streamlit
281 packages built:
  • agi
  • android-tools
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • deja-dup
  • duplicity
  • duply
  • electron-cash
  • electrum
  • electrum-ltc
  • gajim
  • gcalcli
  • gnomecast
  • goobook (python310Packages.goobook)
  • hwi (python310Packages.hwi)
  • keepkey_agent (python310Packages.keepkey_agent)
  • kmymoney
  • krunvm
  • lbdb
  • ledger_agent (python310Packages.ledger_agent)
  • lieer
  • lndmanage
  • lxd
  • mitmproxy (python310Packages.mitmproxy)
  • mitmproxy2swagger
  • mkchromecast
  • mloader
  • nanopb
  • nanopbMalloc
  • ola
  • opensnitch-ui
  • podman
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrcli
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.augmax
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.cirq-google
  • python310Packages.consonance
  • python310Packages.dask-yarn
  • python310Packages.devolo-plc-api
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.einops
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfig
  • python310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mypy-protobuf
  • python310Packages.mysql-connector
  • python310Packages.paranoid-crypto
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymumble
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.skein
  • python310Packages.snakebite
  • python310Packages.sqlglot
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorflow-metadata
  • python310Packages.transformers
  • trezorctl (python310Packages.trezor)
  • trezor_agent (python310Packages.trezor_agent)
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrcli
  • python39Packages.angrop
  • python39Packages.augmax
  • python39Packages.betterproto
  • python39Packages.bitbox02
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.cirq-google
  • python39Packages.consonance
  • python39Packages.dask-yarn
  • python39Packages.devolo-plc-api
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.paranoid-crypto
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.skein
  • python39Packages.snakebite
  • python39Packages.sqlglot
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorflow-metadata
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • qlcplus
  • siril
  • sparrow
  • tauon
  • wapiti

@oxalica oxalica force-pushed the fix/python-protobuf branch from 9e01549 to 49cfef7 Compare October 8, 2022 18:33
@oxalica oxalica changed the title [staging-next] python3Packages.protobuf: pin to 3.20 [staging-next] python3Packages.protobuf: fix drv version and dependent build failures Oct 8, 2022
@oxalica
Copy link
Contributor Author

oxalica commented Oct 8, 2022

I give up pinning it back to 3.20. Now I did the reverse: just correct version to 4.21 and fix build failure of dependent packages by unrestrict the protobuf requirement. This should be fine according to #194112 (comment)

@oxalica
Copy link
Contributor Author

oxalica commented Oct 8, 2022

Most of failures left are either,

  • Hard to fix: protobuf so link failure. or-tools
  • Hard to fix: requirements are inside wheels. streamlit
  • Test failure after the requirement change. electrum-grs
  • Other unrelated failures.

Result of nixpkgs-review run on x86_64-linux 1

226 packages marked as broken and skipped:
  • barman
  • baserow
  • beancount
  • dbx
  • dvc-with-remotes
  • fava
  • gam
  • git-annex-remote-googledrive
  • gphotos-sync
  • gpt2tc
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • kube-hunter
  • ledger2beancount
  • libtensorflow
  • libtensorflow-bin
  • mlflow-server
  • ocamlPackages.torch
  • openai-whisper
  • parsedmarc
  • privacyidea
  • python310Packages.arviz
  • python310Packages.baselines
  • python310Packages.beancount
  • python310Packages.beancount_docverif
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cntk
  • python310Packages.coqui-trainer
  • python310Packages.dalle-mini
  • python310Packages.deepwave
  • python310Packages.distrax
  • python310Packages.django-storages
  • python310Packages.dm-sonnet
  • python310Packages.drivelib
  • python310Packages.edward
  • python310Packages.elegy
  • python310Packages.ezyrb
  • python310Packages.ffcv
  • python310Packages.flax
  • python310Packages.functorch
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-nest-sdm
  • python310Packages.gpt-2-simple
  • python310Packages.gspread
  • python310Packages.ignite
  • python310Packages.kubernetes
  • python310Packages.mask-rcnn
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.openai-whisper
  • python310Packages.openshift
  • python310Packages.optuna
  • python310Packages.parsedmarc
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.pydmd
  • python310Packages.pymanopt
  • python310Packages.pymc
  • python310Packages.pymc3
  • python310Packages.pyro-ppl
  • python310Packages.pytorch
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.pytorchWithCuda
  • python310Packages.pytorchWithoutCuda
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rising
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.scikit-tda
  • python310Packages.shap
  • python310Packages.skorch
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.spacy
  • python310Packages.spacy-loggers
  • python310Packages.spacy-transformers
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-bin
  • python310Packages.tensorflow-bin_2
  • python310Packages.tensorflow-build_2
  • python310Packages.tensorflow-datasets
  • python310Packages.tensorflow-probability
  • python310Packages.tensorflow-tensorboard
  • python310Packages.tensorflow-tensorboard_2
  • python310Packages.tensorflowWithCuda
  • python310Packages.tensorflowWithoutCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchWithCuda
  • python310Packages.torchWithoutCuda
  • python310Packages.torchgpipe
  • python310Packages.torchinfo
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.treex
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.vqgan-jax
  • python310Packages.wandb
  • python310Packages.worldengine
  • python310Packages.zcs
  • python39Packages.arviz
  • python39Packages.baselines
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.cirq
  • python39Packages.cntk
  • python39Packages.coqui-trainer
  • python39Packages.dalle-mini
  • python39Packages.deepwave
  • python39Packages.distrax
  • python39Packages.django-storages
  • python39Packages.dm-sonnet
  • python39Packages.drivelib
  • python39Packages.edward
  • python39Packages.elegy
  • python39Packages.ezyrb
  • python39Packages.ffcv
  • python39Packages.flax
  • python39Packages.functorch
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-nest-sdm
  • python39Packages.gpt-2-simple
  • python39Packages.gspread
  • python39Packages.ignite
  • python39Packages.kubernetes
  • python39Packages.mask-rcnn
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.openai-whisper
  • python39Packages.openshift
  • python39Packages.optuna
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.pot
  • python39Packages.pydmd
  • python39Packages.pymanopt
  • python39Packages.pymc
  • python39Packages.pymc3
  • python39Packages.pyro-ppl
  • python39Packages.pytorch
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.pytorchWithCuda
  • python39Packages.pytorchWithoutCuda
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rising
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.skorch
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.spacy
  • python39Packages.spacy-loggers
  • python39Packages.spacy-transformers
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboardx
  • python39Packages.tensorflow
  • python39Packages.tensorflow-bin
  • python39Packages.tensorflow-bin_2
  • python39Packages.tensorflow-build_2
  • python39Packages.tensorflow-datasets
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflow-tensorboard
  • python39Packages.tensorflow-tensorboard_2
  • python39Packages.tensorflowWithCuda
  • python39Packages.tensorflowWithoutCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchWithCuda
  • python39Packages.torchWithoutCuda
  • python39Packages.torchgpipe
  • python39Packages.torchinfo
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.treex
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.vqgan-jax
  • python39Packages.wandb
  • python39Packages.worldengine
  • python39Packages.zcs
  • s3ql
  • snakemake
  • tandoor-recipes
  • tts
12 packages failed to build:
  • electrum-grs
  • or-tools
  • pynitrokey
  • python310Packages.certbot-dns-google
  • python310Packages.ibis-framework
  • python310Packages.ortools
  • python310Packages.skl2onnx
  • python39Packages.certbot-dns-google
  • python39Packages.ibis-framework
  • python39Packages.ortools
  • python39Packages.skl2onnx
  • streamlit
302 packages built:
  • agi
  • android-tools
  • biliass (python310Packages.biliass)
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • deja-dup
  • duplicity
  • duply
  • electron-cash
  • electrum
  • electrum-ltc
  • esphome
  • gajim
  • gcalcli
  • gnomecast
  • goobook (python310Packages.goobook)
  • hwi (python310Packages.hwi)
  • keepkey_agent (python310Packages.keepkey_agent)
  • kmymoney
  • krunvm
  • lbdb
  • ledger_agent (python310Packages.ledger_agent)
  • lieer
  • lndmanage
  • lxd
  • manim
  • mitmproxy (python310Packages.mitmproxy)
  • mitmproxy2swagger
  • mkchromecast
  • mloader
  • nanopb
  • nanopbMalloc
  • nrfutil
  • ola
  • opensnitch-ui
  • podman
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrcli
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.augmax
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.cairo-lang
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.cirq-google
  • python310Packages.consonance
  • python310Packages.dask-yarn
  • python310Packages.devolo-plc-api
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.einops
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-logging
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfig
  • python310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mypy-protobuf
  • python310Packages.mysql-connector
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.paranoid-crypto
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymumble
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.sagemaker
  • python310Packages.skein
  • python310Packages.snakebite
  • python310Packages.sqlglot
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorflow-metadata
  • python310Packages.transformers
  • trezorctl (python310Packages.trezor)
  • trezor_agent (python310Packages.trezor_agent)
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • yutto (python310Packages.yutto)
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrcli
  • python39Packages.angrop
  • python39Packages.apache-beam
  • python39Packages.augmax
  • python39Packages.betterproto
  • python39Packages.biliass
  • python39Packages.bitbox02
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.cairo-lang
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.cirq-google
  • python39Packages.consonance
  • python39Packages.dask-yarn
  • python39Packages.devolo-plc-api
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-logging
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.manticore
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.paranoid-crypto
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.sagemaker
  • python39Packages.skein
  • python39Packages.snakebite
  • python39Packages.sqlglot
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorflow-metadata
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • python39Packages.yutto
  • qlcplus
  • siril
  • sparrow
  • tauon
  • wapiti

@ehllie ehllie mentioned this pull request Oct 10, 2022
13 tasks
@oxalica oxalica force-pushed the fix/python-protobuf branch from f121b1d to 8bd4d92 Compare November 5, 2022 11:50
@oxalica
Copy link
Contributor Author

oxalica commented Nov 5, 2022

Rebased and removed fixes that already included in master.

@oxalica oxalica requested a review from acairncross November 5, 2022 11:52
@erdnaxe
Copy link
Member

erdnaxe commented Nov 6, 2022

Result of nixpkgs-review pr 194111 run on aarch64-linux 1

/!\ I believe the OOM killer killed something in nixpkgs-review. I set NIXPKGS_ALLOW_UNSUPPORTED_SYSTEM=1. Please take this review as potentially wrong.

58 packages marked as broken and skipped:
  • python310Packages.angrcli
  • python310Packages.arviz
  • python310Packages.augmax
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cirq-google
  • python310Packages.dalle-mini
  • python310Packages.dask-yarn
  • python310Packages.distrax
  • python310Packages.dm-sonnet
  • python310Packages.elegy
  • python310Packages.flax
  • python310Packages.mask-rcnn
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.optuna
  • python310Packages.pydmd
  • python310Packages.pymc
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.skein
  • python310Packages.skorch
  • python310Packages.tensorflow-datasets
  • python310Packages.treex
  • python310Packages.vqgan-jax
  • python310Packages.worldengine
  • python39Packages.angrcli
  • python39Packages.arviz
  • python39Packages.augmax
  • python39Packages.cirq
  • python39Packages.cirq-google
  • python39Packages.dalle-mini
  • python39Packages.dask-yarn
  • python39Packages.distrax
  • python39Packages.dm-sonnet
  • python39Packages.elegy
  • python39Packages.flax
  • python39Packages.manticore
  • python39Packages.mask-rcnn
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.optuna
  • python39Packages.pydmd
  • python39Packages.pymc
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.skein
  • python39Packages.skorch
  • python39Packages.tensorflow-datasets
  • python39Packages.treex
  • python39Packages.vqgan-jax
  • python39Packages.worldengine
  • worldengine-cli
52 packages failed to build:
  • electrum-grs
  • manim
  • or-tools
  • pynitrokey
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.ffcv
  • python310Packages.ortools
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.rising
  • python310Packages.shap
  • python310Packages.spacy
  • python310Packages.spacy-transformers
  • python310Packages.tensorflowWithCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.torchWithCuda
  • python310Packages.torchinfo
  • python310Packages.zcs
  • python39Packages.baselines
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.edward
  • python39Packages.ffcv
  • python39Packages.gpt-2-simple
  • python39Packages.ortools
  • python39Packages.potpython39Packages.pymanopt
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.rising
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.spacy
  • python39Packages.spacy-transformers
  • python39Packages.tensorflow
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflowWithCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torchWithCuda
  • python39Packages.torchinfo
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.zcs
  • streamlit
396 packages built:
  • android-tools
  • barman
  • baserow
  • beancount
  • biliass
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • dbx
  • deja-dupduplicity
  • duply
  • dvc-with-remotes
  • electron-cash
  • electrum
  • electrum-ltc
  • fava
  • gajim
  • gam
  • gcalcli
  • git-annex-remote-googledrive
  • gnomecast
  • goobook
  • gphotos-sync
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • hwi
  • keepkey_agent
  • kmymoney
  • kube-hunter
  • lbdb
  • ledger2beancount
  • ledger_agent
  • libtensorflow
  • lieer
  • lndmanage
  • lxd
  • mitmproxy
  • mitmproxy2swagger
  • mkchromecast
  • mlflow-server
  • mloader
  • mycli
  • mypy-protobuf
  • nanopb
  • nanopbMalloc
  • nrfutil
  • ola
  • openai-whisper
  • opensnitch-ui
  • parsedmarc
  • patroni
  • podman
  • privacyidea
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.baselines
  • python310Packages.beancount_docverif
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.cairo-langpython310Packages.certbot-dns-google
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.consonance
  • python310Packages.devolo-plc-api
  • python310Packages.django-storages
  • python310Packages.drivelib
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.edward
  • python310Packages.einops
  • python310Packages.ezyrb
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-logging
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfigpython310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-nest-sdm
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.gpt-2-simple
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gspread
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.ibis-framework
  • python310Packages.ignite
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.kubernetes
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.mysql-connector
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.opencensus
  • python310Packages.openshift
  • python310Packages.paranoid-crypto
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymanopt
  • python310Packages.pymumble
  • python310Packages.pyro-ppl
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.sagemaker
  • python310Packages.scikit-tda
  • python310Packages.skl2onnx
  • python310Packages.skrl
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.snakebite
  • python310Packages.spacy-loggers
  • python310Packages.sqlglot
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-metadata
  • python310Packages.tensorflow-probability
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchgpipe
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.transformers
  • trezorctl
  • trezor_agent
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.wandb
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrop
  • python39Packages.apache-beam
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.betterproto
  • python39Packages.biliass
  • python39Packages.bitbox02
  • python39Packages.cairo-lang
  • python39Packages.certbot-dns-google
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.consonance
  • python39Packages.devolo-plc-api
  • python39Packages.django-storages
  • python39Packages.drivelib
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.ezyrb
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-logging
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-nest-sdm
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gspread
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.ibis-framework
  • python39Packages.ignite
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.kubernetes
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.openai-whisper
  • python39Packages.opencensus
  • python39Packages.openshift
  • python39Packages.paranoid-crypto
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.pyro-ppl
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.sagemaker
  • python39Packages.skl2onnx
  • python39Packages.skrl
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.snakebite
  • python39Packages.spacy-loggers
  • python39Packages.sqlglot
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorboardx
  • python39Packages.tensorflow-metadata
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchgpipe
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.wandb
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • qlcplus
  • s3ql
  • siril
  • snakemake
  • tandoor-recipes
  • tauon
  • wal_e
  • wapiti
  • yutto

@oxalica
Copy link
Contributor Author

oxalica commented Nov 6, 2022

@erdnaxe Thanks for the test.
This PR should not cause MORE breakage. Those packages requiring protobuf < 4 are already failing because python check the package metadata, which is already correct, instead of the drv version.

I think we should fix them individually in master rather than here, to prevent further conflicts.

@oxalica oxalica changed the title [staging-next] python3Packages.protobuf: fix drv version and dependent build failures [staging-next] python3Packages.protobuf: fix drv version Nov 6, 2022
@vcunat vcunat merged commit 7e3e9bb into NixOS:staging-next Nov 8, 2022
@oxalica oxalica deleted the fix/python-protobuf branch November 8, 2022 06:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

electrum: fails to build on x86_64
7 participants