merge master #44

deepthi912 · 2024-11-29T22:38:52Z

No description provided.

Add some classes to calculate stage equivalence

#14429)" (#14484) This reverts commit b90d1da.

* add a constructor to pass custom transform pipelines * Use TransformPipeline for all transformations * validations already done in transformPipeline * Allow passing custom TransformPipeline to SegmentProcessorFramework

…res with the multi-stage query engine (#14475)

… bitmap with an inverted one (#14487)

…teral-only filter pushdown to leaf stage (#14448)

…6.0 (#14492)

* Realtime segment size threshold metrics * Addessed PR comment

* Minion Task to support automatic Segment Refresh * Address review comments * Address review comments.

…; Replace CLP row value that are too large to store in FixedByteMVMutableForwardIndex with an error message. (#14365) * Add support for storing non-CLP-encodable values in a separate column; Replace CLP row value that are too large to store in FixedByteMVMutableForwardIndex with an error message. * Fix license header * Fixed spelling mistake. * Add metrics. * Fix unit test failure. * Added more comments and description on org.apache.pinot.segment.local.indexsegment.mutable.MutableSegmentImpl.validateLengthOfMVColumns

…lti-stage query engine (#14689)

…the limit is zero (#13564)

…#14717)

…NCT from IN clause (#14719)

…14716) * Fix false data loss alerts in case of read_committed Kafka isolation * Fix null handling --------- Co-authored-by: Kartik Khare <[email protected]>

Bumps software.amazon.awssdk:bom from 2.29.40 to 2.29.41. --- updated-dependencies: - dependency-name: software.amazon.awssdk:bom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…afety issue in the JDBC client (#14723) Use DateTimeFormatter instead of SimpleDateFormat to resolve thread safety issue in the JDBC client

Bumps [com.puppycrawl.tools:checkstyle](https://github.com/checkstyle/checkstyle) from 10.21.0 to 10.21.1. - [Release notes](https://github.com/checkstyle/checkstyle/releases) - [Commits](checkstyle/checkstyle@checkstyle-10.21.0...checkstyle-10.21.1) --- updated-dependencies: - dependency-name: com.puppycrawl.tools:checkstyle dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps software.amazon.awssdk:bom from 2.29.41 to 2.29.43. --- updated-dependencies: - dependency-name: software.amazon.awssdk:bom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…ement (#14726)

… Expression (#14732)

xiangfu0 and others added 30 commits November 15, 2024 00:36

Enhance funnel functions to accept a new option for stepMaxDuration (#…

ec9d078

…14434)

Bump com.nimbusds:nimbus-jose-jwt from 9.46 to 9.47 (#14465)

eede87f

Bump codecov/codecov-action from 4 to 5 (#14463)

f571a56

log the instance configs properly (#14468)

2354b8e

Bump software.amazon.awssdk:bom from 2.29.11 to 2.29.14 (#14466)

c003cc9

Fix Flaky test # 14456 (#14462)

8091415

Refactor String.format to Concatenation (#14418)

a51b1d1

Upgrade orc from 1.9.4 to 1.9.5 (#14471)

07962b0

Bump net.openhft:posix from 2.26ea3 to 2.27ea0 (#14482)

817af8b

Bump software.amazon.awssdk:bom from 2.29.14 to 2.29.15 (#14480)

cbef31f

Bump net.openhft:chronicle-core from 2.26ea2 to 2.27ea0 (#14481)

e176522

[spool] Define equivalence between stages (#14296)

f61f47b

Add some classes to calculate stage equivalence

add support for prefix/suffix for taskname (#14478)

179be30

Spark upsert table backfill support (#14443)

776e815

Revert "Using local copy of segment instead of downloading from remote (

d9b4723

#14429)" (#14484) This reverts commit b90d1da.

Use TransformPipeline in SegmentMapper (#14425)

a6ac892

* add a constructor to pass custom transform pipelines * Use TransformPipeline for all transformations * validations already done in transformPipeline * Allow passing custom TransformPipeline to SegmentProcessorFramework

Add TLS support to mailboxes used in the multi-stage engine (#14476)

f08c159

Show multi-stage engine explain plan for integration test query failu…

3fea2a2

…res with the multi-stage query engine (#14475)

Fix BitmapCollection::orCardinality API when combining a non-inverted…

c096c70

… bitmap with an inverted one (#14487)

Apply filter reduce expressions Calcite rule at the end to prevent li…

bc71221

…teral-only filter pushdown to leaf stage (#14448)

Bump net.openhft:chronicle-core from 2.27ea0 to 2.27ea1 (#14490)

7fffb2d

Bump software.amazon.awssdk:bom from 2.29.15 to 2.29.16 (#14491)

2a9ddf3

Bump com.google.errorprone:error_prone_annotations from 2.35.1 to 2.3…

c964d7c

…6.0 (#14492)

Make TableDataManagerProvider pluggable (#14470)

8300838

Realtime segment size threshold metrics (#14485)

b9965c8

* Realtime segment size threshold metrics * Addessed PR comment

add more logging and metric to compaction task generator (#14469)

89622c0

Fix timestamp literal handling in the multi-stage query engine (#14502)

a914940

Minion Task to support automatic Segment Refresh (#14300)

a9abd14

* Minion Task to support automatic Segment Refresh * Address review comments * Address review comments.

Retain boolean type from CLPLogRecordExtractor decoder. (#14497)

96bf183

Jackie-Jiang and others added 30 commits December 20, 2024 12:56

[Multi-stage] Reduce PinotQuery copy (#14669)

07998f4

Adding gauges for upstream and consuming offsets (#14600)

0e9c30a

Adding gauge for minion subtasks in unknown state (#14693)

1ed25c0

Fix broken BIG_DECIMAL aggregations (MIN / MAX / SUM / AVG) in the mu…

616d691

…lti-stage query engine (#14689)

Adding more arithmetic functions (#14671)

becb57e

Bump software.amazon.awssdk:bom from 2.29.38 to 2.29.39 (#14708)

4edb574

Bump com.microsoft.azure:msal4j from 1.17.3 to 1.18.0 (#14705)

e957e69

Bump com.nimbusds:nimbus-jose-jwt from 9.47 to 9.48 (#14704)

99a10ff

Bump jna.version from 5.15.0 to 5.16.0 (#14706)

a7470a9

Include exception when no server is found (#14709)

9be162a

Add support for Cursors through API Query Params (#14110)

73843b5

Fix v1 query engine behavior for aggregations without group by where …

b398fed

…the limit is zero (#13564)

Fix testGroupByAggregationWithLimitZero expected type (#14710)

383bbce

Bump software.amazon.awssdk:bom from 2.29.39 to 2.29.40 (#14711)

dae0191

Bump nl.jqno.equalsverifier:equalsverifier from 3.17.5 to 3.18 (#14712)

141655c

[timeseries] Part-4: Complete Support for Multi-Server Queries (#14676)

a6a3b40

add icons and shortcuts for query submit and format (#14697)

e98389d

Remove the unused streaming combine operator (#14718)

6e4fd12

Re-implement distinct operators (#14701)

81188b1

Increase visibility of PinotTaskManager class for better pluggability (…

2e6e3d6

…#14717)

Remove PinotAggregateToSemiJoinRule which can mistakenly remove DISTI…

c50ed0d

…NCT from IN clause (#14719)

Fix false data loss alerts in case of read_committed Kafka isolation (#…

00f0721

…14716) * Fix false data loss alerts in case of read_committed Kafka isolation * Fix null handling --------- Co-authored-by: Kartik Khare <[email protected]>

Extend to add Default Server level configs for Dedup Tables (#14684)

86a82dd

Use DateTimeFormatter instead of SimpleDateFormat to resolve thread s…

3de0265

…afety issue in the JDBC client (#14723) Use DateTimeFormatter instead of SimpleDateFormat to resolve thread safety issue in the JDBC client

Fix a bug for partition enabled instance assignment with minimize mov…

351e464

…ement (#14726)

[Multi-stage] Support is_enable_group_trim agg option (#14664)

f98b250

Optimize MergeEqInFilterOptimizer by reducing the hash computation of…

9b96068

… Expression (#14732)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

merge master #44

merge master #44

deepthi912 commented Nov 29, 2024

merge master #44

Are you sure you want to change the base?

merge master #44

Conversation

deepthi912 commented Nov 29, 2024