Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Index setting partition size is ignored if routing num shard setting is not specified, leading to ingestion to single shard #17472

Open
MilanCoder opened this issue Feb 27, 2025 · 0 comments
Labels
bug Something isn't working Indexing Indexing, Bulk Indexing and anything related to indexing untriaged

Comments

@MilanCoder
Copy link

Describe the bug

Hi,

We came up with an issue in opensearch 2.11 where while ingesting data into an index, all the data was getting routed to single shard even if we specify the partition size to more than 1 as value, it seems the data was only getting distributed to multiple shards if we specify the routing num shards setting value to equal to num of shards.

Setting used without routing num shards setting :

` "settings": {
      "number_of_shards": 20,
      "index.routing_partition_size": 3,
      "number_of_replicas": 0,
      "refresh_interval": "300s"
  },`

Setting used with routing num shards setting which works as expected.

 "settings": {
      "number_of_shards": 20,
      "index.routing_partition_size": 3,
      "number_of_replicas": 0,
      "refresh_interval": "300s",
      "number_of_routing_shards":20
  },

Related component

No response

To Reproduce

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior

It should work without specifying routing num shards setting. The data should get distributed across shards.

Additional Details

Plugins
Please list all plugins currently enabled.

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: [e.g. iOS]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@MilanCoder MilanCoder added bug Something isn't working untriaged labels Feb 27, 2025
@andrross andrross added Indexing Indexing, Bulk Indexing and anything related to indexing and removed _No response_ labels Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Indexing Indexing, Bulk Indexing and anything related to indexing untriaged
Projects
None yet
Development

No branches or pull requests

2 participants