kibana_index data source limits 100 indexes

[andresvia]

Hi @ewilde.

I'm trying to use your provider.

I have a kibana instance with a bunch of indices, so when I try to use it like this:

data "kibana_index" "foo" {
  filter {
    name = "title"
    values = ["foo"]
  }
}

output "foo" {
  value = data.kibana_index.foo
}

The result is empty despite having an index called foo. (The apply continues without errors, but it should be a failure instead -i think-).

Apply complete! Resources: 0 added, 0 changed, 0 destroyed.

Outputs:

foo = {}

I looked at the query and realized that go-kibana is making a find query.

/api/saved_objects/_find?fields=title&fields=timeFieldName&fields=fields&per_page=100&type=index-pattern

Limited to 100 results.

I wasn't sure where to create the issue if here or in go-kibana

If you have an idea where should I start looking to fix the issue, please let me know, I can probably take a look and understand more about what the provider is doing and eventually submit a fix/pr.

Thanks.

Update: realized the limit is set here:

terraform-provider-kibana/kibana/data_source_kibana_index.go

Line 64 in 5708a18

WithPerPage(100).

[cbrgm]

Hey, this issue is still unresolved, right? I'm currently in the same situation where I'd like to create a lot of instances via terraform. The 100 items limit would be a major drawback. How did you proceed in your case?