merge master #31
Merged
merge master #31
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* extract common utils for preloading to reuse for dedup table * minor refines
…roperties (IndexLoadingConfig) (#14153)
…the multistage engine (#14128)
Co-authored-by: Laxman Ch <[email protected]>
This PR adds the missing validation and improves error messages, e.g. `numGroupsLimit must be a number between 0 and 2^31-1, got: 10000000000` for the following options: numGroupsLimit maxInitialResultHolderCapacity multiStageLeafLimit groupTrimThreshold maxStreamingPendingBlocks maxRowsInJoin maxRowsInWindow numReplicaGroupsToQuery maxExecutionThreads > 0 minSegmentGroupTrimSize > -1 minServerGroupTrimSize minBrokerGroupTrimSize > 0, v1 only timeoutMs maxServerResponseSizeBytes maxQueryResponseSizeBytes
* add lucene.properties metadata file per lucene index * add javadoc * improve javadoc
* try to acquire segmentLock before taking segment snapshot * refine to ensure snapshots kept on disk are disjoint * fix tests and add tests
…nd found Text Index data is not deterministic (#14188)
…adata push jobs (#14139) * consistent push for spark 3 jobs + tests * remove unneeded comment * dont specify pinot-batch-ingestion-spark-3 version * use root spark3 defined version * reduce consistent vs non consistent branching count - cleaner code * remove useless comment * format to pinot code style * use batch upload capability when configured + add tests * use ci friendly instantiation of spark for the tests --------- Co-authored-by: Priyen Patel <[email protected]>
…l values in segment columns (#14177)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.