Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplify setting credentials when switching between different environments #3940

Open
ElenaKhaustova opened this issue Jun 6, 2024 · 1 comment
Labels
Issue: Feature Request New feature or improvement to existing feature

Comments

@ElenaKhaustova
Copy link
Contributor

Description

Accessing credentials and setting them for different environments is not simple. Users have to define separate catalog entries for different environments to be able to switch between them. They expect to define one catalog entry per credential or/and some guidance on how to make it simpler for such cases.

We propose to:

  1. Explore the feasibility of such a request.
  2. Check if it is possible to simplify switching between environments with the existing credential configuration options and update documentation with the relevant examples.

Relates to #3811

Context

When running on local they had credentials.yml with a password but when running on AWS Glue they had to use this method to access the same credentials.

image (14)

@ElenaKhaustova ElenaKhaustova added the Issue: Feature Request New feature or improvement to existing feature label Jun 6, 2024
@datajoely
Copy link
Contributor

datajoely commented Jun 6, 2024

I think a powerful OmegaConf resolver would be really useful...

"${credentials: sql_user}"

The dumbest version of this is something like this, but it could be way more useful:

def get_credentials(path) -> str:
    """Retrieve credentials earlier in the lifecycle"""
    data = OmegaConf.load("conf/local/credentials.yml")
    return OmegaConf.select(data, path)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Issue: Feature Request New feature or improvement to existing feature
Projects
Status: No status
Development

No branches or pull requests

3 participants