Bitmap Filtering Performance Improvement

[bowenlan-amzn]

We have pinned down the cause of slow bitmap filtering as reported by user.

Profliing shows most time are taken by these 2 places

• Cost estimation of PointInSetQuery

https://github.com/apache/lucene/blob/1ebee9e6116b1dbc5bcd410b4180df1f9c4c9d50/lucene/core/src/java/org/apache/lucene/search/PointInSetQuery.java#L204-L207

• Constructor of PointInSetQuery

https://github.com/apache/lucene/blob/1ebee9e6116b1dbc5bcd410b4180df1f9c4c9d50/lucene/core/src/java/org/apache/lucene/search/PointInSetQuery.java#L92-L124

We plan to implement a specialized index query for bitmap filtering.

---

See the below profiling results.
https://github.com/bowenlan-amzn/file-share/blob/99d4fe6285e8b17128d1dd34951114612a733740/data2_flamegraph_20241002-221330.html

A quick experiment to improve from @msfroh bowenlan-amzn@105f58c#diff-4fa5d4f7924d3efa290acf2bf6a6a7821c0c4be9b8edeb1d6471c9e0b14dc201R1556

Original PR #14774 #16317 (comment)