Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to build Python package due to missing layer/experimental build #776

Open
jonas-eschle opened this issue Apr 21, 2024 · 2 comments
Open
Assignees
Labels

Comments

@jonas-eschle
Copy link
Contributor

System information.

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 22.04
  • TensorFlow installed from (source or binary): source
  • TensorFlow version (use command below): 2.16
  • Python version: 3.11
  • Bazel version (if compiling from source): 6.5.0

Describe the problem.

When trying to compile tf-keras (adding it to spack here: spack/spack#43688), it fails when building the python package using create_pip_helper with

PipPackagingError: Pip package missing the file ./tf_keras/layers/experimental/dynamic_lookup.py. If this is expected, add it to PIP_EXCLUDED_FILES in create_pip_helper.py. Otherwise, make sure it is a build dependency of the pip package

Cause

The module layers/experimental (https://github.com/keras-team/tf-keras/tree/master/tf_keras/layers/experimental) doesn't seem to be listed in the BUILD script (https://github.com/keras-team/tf-keras/blob/master/tf_keras/layers/BUILD#L36). Most likely, it should just be added to it?

Helper has an exluding list here https://github.com/keras-team/tf-keras/blob/master/tf_keras/tools/pip_package/create_pip_helper.py#L25 but layer/experimental isn't there either (it should, presumably, be compiled).

Contributing.

  • Do you want to contribute a PR? (yes/no): yes
  • If yes, please read this page for instructions
  • Briefly describe your candidate solution(if contributing):
@mattdangerw
Copy link
Member

@jonas-eschle agreed that adding this to the build rule sounds like the right call. Can you try that out? Thanks!

@jonas-eschle
Copy link
Contributor Author

I tried but actually run into the issue that layers/experimental cannot be used as a build target, as the builds inside experimental require layers -> circular deps. The other folders in layers circumvent this by specifying only the specific build targets.

Instead of changing the logic (i.e. is experimental meant to be dev-built only?), I did what the error advertised and added it to the ignored builds, as it's seemingly not made to be built (see PR #779 )

copybara-service bot pushed a commit that referenced this issue Oct 15, 2024
Imported from GitHub PR #779

As discussed in #776

I tried but actually run into the issue that layers/experimental cannot be used as a build target, as the builds _inside_ experimental _require_ layers -> circular deps. The other folders in `layers` circumvent this by specifying only the specific build targets.

Instead of changing the logic (i.e. is experimental meant to be dev-built only?), I did what the error advertised and added it to the ignored builds, as it's seemingly not made to be built
Copybara import of the project:

--
9d3bb64 by Jonas Eschle <[email protected]>:

docs: update CONTRIBUTING.md with new name tf-keras

(cherry picked from commit fb79960)

--
7bd7b3d by Jonas Eschle <[email protected]>:

fix: python build ignore experimental due to circular refs

(cherry picked from commit 9b349e3)

Merging this change closes #779

FUTURE_COPYBARA_INTEGRATE_REVIEW=#779 from jonas-eschle:fix_pip_build 7bd7b3d
PiperOrigin-RevId: 685927076
copybara-service bot pushed a commit that referenced this issue Oct 16, 2024
Imported from GitHub PR #779

As discussed in #776

I tried but actually run into the issue that layers/experimental cannot be used as a build target, as the builds _inside_ experimental _require_ layers -> circular deps. The other folders in `layers` circumvent this by specifying only the specific build targets.

Instead of changing the logic (i.e. is experimental meant to be dev-built only?), I did what the error advertised and added it to the ignored builds, as it's seemingly not made to be built
Copybara import of the project:

--
9d3bb64 by Jonas Eschle <[email protected]>:

docs: update CONTRIBUTING.md with new name tf-keras

(cherry picked from commit fb79960)

--
7bd7b3d by Jonas Eschle <[email protected]>:

fix: python build ignore experimental due to circular refs

(cherry picked from commit 9b349e3)

Merging this change closes #779

FUTURE_COPYBARA_INTEGRATE_REVIEW=#779 from jonas-eschle:fix_pip_build 7bd7b3d
PiperOrigin-RevId: 685927076
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants