Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flexible naming on stage schema #1519

Closed
shion-w opened this issue Jun 26, 2024 · 1 comment
Closed

Flexible naming on stage schema #1519

shion-w opened this issue Jun 26, 2024 · 1 comment
Assignees

Comments

@shion-w
Copy link

shion-w commented Jun 26, 2024

Feature description

Currently there is no flexibility in naming the stage schema which defaults to {name}_STAGING. While this is great for general use, it might be beneficial to give users the flexibility to define their own name for the staging schema.

Are you a dlt user?

Yes, I'm already a dlt user.

Use case

Internally we have a strict naming standards for our schemas in Snowflake which prevents the implementation of dlt. With this in place, it would allow dlt to be implemented in stacks where naming standards are strict.

Proposed solution

I think from an implementation side, it might be beneficial to add it in the pipeline declaration

pipeline = dlt.pipeline(destination='snowflake', dataset_name='raw_salesforce', stage_dataset_name='stage_salesforce')

Related issues

No

@rudolfix rudolfix moved this from Todo to In Progress in dlt core library Jul 8, 2024
@rudolfix rudolfix self-assigned this Jul 8, 2024
@rudolfix
Copy link
Collaborator

rudolfix commented Jul 8, 2024

@shion-w
this is solved by #1555 and implemented like in #919 (via config or via destination factory)
to be released in 0.5.1

@rudolfix rudolfix closed this as completed Jul 8, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in dlt core library Jul 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

2 participants