Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

low-code: Remove NoPagination from the interface #24978

Closed

Conversation

girarda
Copy link
Contributor

@girarda girarda commented Apr 7, 2023

What

This is a follow up PR to #24976

The NoPagination object does not need to be exposed in the DSL because the SimpleRetriever's paginator field is optional.

This removes the NoPagination from the manifest schema so we don't need to document and maintain it.

How

  • Remove NoPagination from the schema
  • Update the SimpleRetriever's paginator type to be only DefaultPaginator
  • Delete airbyte-cdk/python/airbyte_cdk/sources/declarative/parsers/class_types_registry.py because it is not used anymore
  • Delete airbyte-cdk/python/airbyte_cdk/sources/declarative/parsers/default_implementation_registry.py because it is not used anymore
  • Update the component factory
  • Update unit tests that explicitly refer to NoPagination
  • Update the docs

Recommended reading order

  1. airbyte-cdk/python/airbyte_cdk/sources/declarative/declarative_component_schema.yaml
  2. airbyte-cdk/python/airbyte_cdk/sources/declarative/models/declarative_component_schema.py
  3. docs/connector-development/config-based/tutorial/3-connecting-to-the-API-source.md
  4. docs/connector-development/config-based/tutorial/5-incremental-reads.md
  5. docs/connector-development/config-based/understanding-the-yaml-file/pagination.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation CDK Connector Development Kit connectors/source/alpha-vantage connectors/source/braze connectors/source/breezometer connectors/source/chartmogul connectors/source/clickup-api connectors/source/close-com connectors/source/coin-api connectors/source/coinmarketcap connectors/source/configcat connectors/source/convertkit connectors/source/dremio connectors/source/emailoctopus connectors/source/facebook-pages connectors/source/gnews connectors/source/google-pagespeed-insights connectors/source/google-webfonts connectors/source/instatus connectors/source/intercom connectors/source/ip2whois connectors/source/k6-cloud connectors/source/mailerlite connectors/source/mailjet-mail connectors/source/mailjet-sms connectors/source/metabase connectors/source/monday connectors/source/nytimes connectors/source/pendo connectors/source/pexels-api connectors/source/plausible connectors/source/polygon-stock-api connectors/source/punk-api connectors/source/pypi connectors/source/recruitee connectors/source/reply-io connectors/source/rocket-chat connectors/source/sap-fieldglass connectors/source/sendgrid connectors/source/sentry connectors/source/smaily connectors/source/smartengage connectors/source/spacex-api connectors/source/survey-sparrow connectors/source/tmdb connectors/source/toggl connectors/source/tvmaze-schedule connectors/source/tyntec-sms connectors/source/unleash connectors/source/waiteraid connectors/source/whisky-hunter connectors/source/wikipedia-pageviews connectors/source/zapier-supported-storage connectors/source/zoom
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants