You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This behaviour is misleading and not intuitive. And also requires to additionally specify same computes several times in profiles and model configurations which breaks the usage of different profiles and targets in your project.
Steps To Reproduce
Secondary databricks compute is set as all_purpose compute
profiles.yml:
Describe the bug
https://docs.getdbt.com/reference/resource-configs/databricks-configs#specifying-compute-for-python-models
Documentation says:
"When you specify your databricks_compute for a python model, you are currently only specifying which compute to use when running the model-specific SQL. If you wish to use a different compute for executing the python itself, you must specify an alternate compute in the config for the model."
This behaviour is misleading and not intuitive. And also requires to additionally specify same computes several times in profiles and model configurations which breaks the usage of different profiles and targets in your project.
Steps To Reproduce
profiles.yml:
dbt_project.yml:
Expected behavior
When 'databricks_compute' is set for python models and it is all purpose compute they should use it for both Python and SQL parts.
The text was updated successfully, but these errors were encountered: