[24.1] Limit max number of items in dataproviders

[mvdbeek]

that support pagination to 10000. Clients can always request more data via offset requests, but since this is not a streaming API we need to build the response in memory before we can start sending.

How to test the changes?

(Select all options that apply)

• I've included appropriate automated tests.
• This is a refactoring of components with existing test coverage.
• Instructions for manual testing are as follows:
  1. [add testing steps and prerequisites here if you didn't write automated tests covering all your changes]

License

• I agree to license these and all my past contributions to the core galaxy codebase under the MIT license.

[galaxyproject-sentryintegration]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ ReferenceDataError: No reference data for Arabidopsis_thaliana_TAIR10 /api/datasets/{dataset_id} View Issue
• ‼️ NoProviderAvailable: No provider available in factory_source "<galaxy.datatypes.registry.Text object at 0x7f26d7653610... /api/datasets/{dataset_id} View Issue
• ‼️ AttributeError: 'NoneType' object has no attribute 'upper' /api/datasets/{dataset_id} View Issue
• ‼️ ValueError: invalid literal for int() with base 10: '2.44214' /api/datasets/{dataset_id} View Issue
• ‼️ AttributeError: 'NoneType' object has no attribute 'get_filters' /api/datasets/{dataset_id} View Issue

_{Did you find this useful? React with a 👍 or 👎}