Code

[Spool] Actual implementation#14507

Code

Merged

gortiz merged 24 commits intoapache:masterapache/pinot:masterfrom gortiz:spool3gortiz/pinot:spool3Copy head branch name to clipboardJan 7, 2025

+596-174

Commits

Commits on Nov 19, 2024

• Support stage replacement

  gortiz

  committed
  982ac13

  Copy full SHA for 982ac13

• Verify the case where a spool tries to send twice to the same stage

  gortiz

  committed
  d02b5cb

  Copy full SHA for d02b5cb

• Add tests that verifies that different distribution breaks equivalence

  gortiz

  committed
  05b894e

  Copy full SHA for 05b894e

Commits on Nov 20, 2024

• Fix root mailbox send node build using null receiver stage

  gortiz

  committed
  1597f5b

  Copy full SHA for 1597f5b

• Remove unused variable

  gortiz

  committed
  91b1b55

  Copy full SHA for 91b1b55

• Fix MailboxReceiveNode.equals, broken in previous spool commits

  gortiz

  committed
  37168a0

  Copy full SHA for 37168a0

• Hide the receiver stage bit set in MailboxSendNode

  gortiz

  committed
  fe22305

  Copy full SHA for fe22305

Commits on Nov 21, 2024

• Apply suggestions from code review

  Show description for a72157f
  

  gortiz

  and

  yashmayya

  authored
  a72157f

  Copy full SHA for a72157f

• Make _senderStageId mutable to simplify getSenderStageId() logic

  gortiz

  committed
  edf8542

  Copy full SHA for edf8542

• Make StagesTestBase.Spool static

  gortiz

  committed
  5bff873

  Copy full SHA for 5bff873

• Rename Spool as SpoolBuilder and add javadoc explaining the class

  gortiz

  committed
  8263de3

  Copy full SHA for 8263de3

• Fix error added in a previous commit

  gortiz

  committed
  3b252cf

  Copy full SHA for 3b252cf

• Support spool in runtime. Still not complete.

  Show description for 32fa712
  gortiz

  committed
  32fa712

  Copy full SHA for 32fa712

• Fix design issues in multi-sender MailboxSendNode

  gortiz

  committed
  f3bffb3

  Copy full SHA for f3bffb3

• Add some explain physical plans with spool

  gortiz

  committed
  f06138a

  Copy full SHA for f06138a

Commits on Dec 13, 2024

• Merge branch 'master' into spool3

  gortiz

  committed
  0b45a95

  Copy full SHA for 0b45a95

• Add some logs in trace mode

  gortiz

  committed
  cb7ff1f

  Copy full SHA for cb7ff1f

• Rename spool resource tests

  gortiz

  committed
  7d63fbf

  Copy full SHA for 7d63fbf

Commits on Dec 16, 2024

• Fix error detected (and only affecting) tests. Improve logs

  gortiz

  committed
  0479a2b

  Copy full SHA for 0479a2b

• Merge remote-tracking branch 'origin/master' into spool3

  gortiz

  committed
  53cebc8

  Copy full SHA for 53cebc8

Commits on Dec 18, 2024

• Merge branch 'master' into spool3

  gortiz

  committed
  6907740

  Copy full SHA for 6907740

Commits on Dec 23, 2024

• Change a log as suggested in PR

  gortiz

  committed
  5ce60e5

  Copy full SHA for 5ce60e5

• Merge remote-tracking branch 'origin/master' into spool3

  gortiz

  committed
  c4f5823

  Copy full SHA for c4f5823

Commits on Jan 2, 2025

• Change GreedyShuffleRewriteVisitor to be closer to the original one

  Show description for cfeb8c4
  gortiz

  committed
  cfeb8c4

  Copy full SHA for cfeb8c4