Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

airbyte-ci: use the base image to build java connectors #49832

Conversation

alafanechere
Copy link
Contributor

@alafanechere alafanechere commented Dec 17, 2024

What

Closes https://github.com/airbytehq/airbyte-internal-issues/issues/11151

We started publishing base image for our java connectors in #49831 .
To make this base image used we should enable java connectors to express the base image they want to use in metadata.yaml like we do for java connectors.
This PR updates airbyte-ci to build java connectors from the base image declared in metadata.yaml.
It also marks the original build code paths as deprecated.

Connector testing

Copy link

vercel bot commented Dec 17, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 17, 2024 5:38pm

Copy link
Contributor Author

alafanechere commented Dec 17, 2024

@alafanechere alafanechere force-pushed the augustin/12-17-airbyte-ci_use_the_base_image_to_build_java_connectors branch 2 times, most recently from 5f76a08 to 0ec995a Compare December 17, 2024 09:29
@octavia-squidington-iii octavia-squidington-iii added area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/postgres labels Dec 17, 2024
@alafanechere alafanechere marked this pull request as ready for review December 17, 2024 10:59
@alafanechere alafanechere requested review from a team as code owners December 17, 2024 10:59
@octavia-squidington-iii octavia-squidington-iii removed area/connectors Connector related issues area/documentation Improvements or additions to documentation labels Dec 17, 2024
Copy link
Contributor

@postamar postamar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. I'm happy if the CI/CD is happy!


return wrapper

return decorator
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

til!


connector_container = (
base.with_workdir("/airbyte")
.with_env_variable("APPLICATION", application)
.with_mounted_directory("built_artifacts", build_stage.directory("/airbyte"))
.with_exec(sh_dash_c(["mv built_artifacts/* ."]))
.with_entrypoint(entrypoint)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just checking: this is safe to remove? I don't actually know

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes it it, I set it in the base image. And if the base image code path is not taken I added the entrypoint explicitely on line 177 and 183

@octavia-squidington-iv octavia-squidington-iv requested a review from a team December 17, 2024 14:01
@alafanechere alafanechere force-pushed the augustin/12-17-base-images_declare_a_base_image_for_our_java_connectors branch from 10dc398 to 6bd024b Compare December 17, 2024 16:19
@alafanechere alafanechere force-pushed the augustin/12-17-airbyte-ci_use_the_base_image_to_build_java_connectors branch from 1c050a0 to 2c15502 Compare December 17, 2024 16:25
@alafanechere alafanechere force-pushed the augustin/12-17-base-images_declare_a_base_image_for_our_java_connectors branch from 6bd024b to 569f2df Compare December 17, 2024 17:14
@alafanechere alafanechere force-pushed the augustin/12-17-airbyte-ci_use_the_base_image_to_build_java_connectors branch from 2c15502 to de5b7b7 Compare December 17, 2024 17:14
Base automatically changed from augustin/12-17-base-images_declare_a_base_image_for_our_java_connectors to master December 17, 2024 17:30
@alafanechere alafanechere force-pushed the augustin/12-17-airbyte-ci_use_the_base_image_to_build_java_connectors branch from de5b7b7 to b647e43 Compare December 17, 2024 17:33
@alafanechere alafanechere enabled auto-merge (squash) December 17, 2024 17:46
@alafanechere alafanechere merged commit 8ad2776 into master Dec 17, 2024
32 checks passed
@alafanechere alafanechere deleted the augustin/12-17-airbyte-ci_use_the_base_image_to_build_java_connectors branch December 17, 2024 17:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants