Skip to content
This repository has been archived by the owner on Jan 4, 2022. It is now read-only.

[DISCUSSION] How should this ideally interact with Databricks "Repos for Git integration"? #79

Open
pgorsira opened this issue Nov 1, 2021 · 0 comments

Comments

@pgorsira
Copy link

pgorsira commented Nov 1, 2021

Databricks Repos for Git Integration seems like a relatively new way to manage / deploy code in a Databricks environment. I understand that cicd-templates uses dbx which (this part may be wrong) packages up jobs into .whl files to be installed in Databricks environments.

From the "Repos for Git Integration" docs, one part says:

If you are using %run commands to make Python or R functions defined in a notebook available to another notebook, or are installing custom .whl files on a cluster, consider including those custom modules in a Databricks repo.

This seems like a different approach vs. the dbx approach. Just wondering if there are any guidelines here on what's appropriate when, how these approaches overlap / complement each other, and if the future of this project / dbx involves a deeper integration with the "Repos" approach.

@renardeinside renardeinside changed the title How should this ideally interact with Databricks "Repos for Git integration"? [DISCUSSION] How should this ideally interact with Databricks "Repos for Git integration"? Nov 3, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant