We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DltResource
rest_api
We could combine instances of regular resources with a. Such config could look like this:
@dlt.resource(name="stories") def read_stories(limit: int = 10): ... @dlt.source(name="hacker_news_source", max_table_nesting=2) def hacker_news_source( base_url: str = dlt.config.value, ) -> List[DltResource]: # source configuration source_config: RESTAPIConfig = { "client": { "base_url": base_url, }, "resources": [ { "name": "item", "table_name": "item", "endpoint": { "path": "/item/{id}.json", "data_selector": "$", "paginator": "single_page", "params": { "id": { "type": "resolve", "field": "$", "resource": "stories" } }, }, }, read_stories(20) ], } return rest_api_source(source_config)
Above we add resource instance with the name "stories" and also attach it to a transformer that is fully declared
Yes, I'm already a dlt user.
Yes, I'm ready.
No response
The text was updated successfully, but these errors were encountered:
TODO: Update the docs after this feature is merged
Sorry, something went wrong.
Relevant discussion in the community Slack https://dlthub-community.slack.com/archives/C04DQA7JJN6/p1726574128329839
willi-mueller
Successfully merging a pull request may close this issue.
Source name
rest_api
Describe the data you'd like to see
We could combine instances of regular resources with a. Such config could look like this:
Above we add resource instance with the name "stories" and also attach it to a transformer that is fully declared
Are you a dlt user?
Yes, I'm already a dlt user.
Do you ready to contribute this extension?
Yes, I'm ready.
dlt destination
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: