Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

client: Support parallel TSO RPC requests on single dispatcher loop #8633

Open
wants to merge 42 commits into
base: master
Choose a base branch
from
Open

client: Support parallel TSO RPC requests on single dispatcher loop #8633

wants to merge 42 commits into from
+828 −50

Commits on Aug 5, 2024

  1. Add implementation of making tsoStream asynchronous 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    140a7c2 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Add basic tests for rewritten tsoStream 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    88d9f5b View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Add a concurrency test 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    623d896 View commit details
    Browse the repository at this point in the history

  2. Fix some of CI failures 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    86d0f42 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Fix integration tests 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    ff0f11a View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Fix tso deadline 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    ef47b9d View commit details
    Browse the repository at this point in the history

  2. Fix stream broken handling 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    ff1d50d View commit details
    Browse the repository at this point in the history

  3. Fix comments 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    9076c9d View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. try to avoid double invocation to the callback 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    39e4e0b View commit details
    Browse the repository at this point in the history

  2. Fix lint 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    632781b View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Address comments 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    8809c45 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Pass context outside the tsoStream (push for running CI) 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ca64ed0 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. client: Add benchmark for tsoStream and dispatcher 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    67967e4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'm/add-benchmarks-for-tso-stream-and-dispatcher' into m/… 

    …make-tso-stream-async
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1362aac View commit details
    Browse the repository at this point in the history

  3. Fix build 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4699b41 View commit details
    Browse the repository at this point in the history

  4. Reimplement mock receiving 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7dbcd77 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'm/add-benchmarks-for-tso-stream-and-dispatcher' into m/… 

    …make-tso-stream-async
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    f4dc99a View commit details
    Browse the repository at this point in the history

  6. Fix disptacher benchmark 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1f2dcd8 View commit details
    Browse the repository at this point in the history

  7. Fix incorrect error generating 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    123a869 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'm/add-benchmarks-for-tso-stream-and-dispatcher' into m/… 

    …make-tso-stream-async
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    2c6aaba View commit details
    Browse the repository at this point in the history

  9. Disable logs in BenchmarkTSOStreamSendRecv 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    bff9eae View commit details
    Browse the repository at this point in the history

  10. Fix lint 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ef6e365 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'm/add-benchmarks-for-tso-stream-and-dispatcher' into m/… 

    …make-tso-stream-async
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a9f4aee View commit details
    Browse the repository at this point in the history

  12. Make the comments more clear; unset req.streamID when getting new tso… 

    …Request from the pool

Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    388d705 View commit details
    Browse the repository at this point in the history

  13. Fix lint 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a183aca View commit details
    Browse the repository at this point in the history

  14. Add latency estimation 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4296c3f View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Support concurrent RPC 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    9b5b054 View commit details
    Browse the repository at this point in the history

  2. Merge commit '098b802fc' into m/support-parallel-tso-requests-in-one-… 

    …stream
    @MyonKeminta
    MyonKeminta committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    c44339f View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into m/support-paralle… 

    …l-tso-requests-in-one-stream
    @MyonKeminta
    MyonKeminta committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    364101f View commit details
    Browse the repository at this point in the history

  4. Fix token not acquired when maxBatchSize is reached before token is r… 

    …eady

Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    4bb33a2 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Merge branch 'master' of https://github.com/tikv/pd into m/support-pa… 

    …rallel-tso-requests-in-one-stream
    @MyonKeminta
    MyonKeminta committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    f016265 View commit details
    Browse the repository at this point in the history

  2. fix lint 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e7590ec View commit details
    Browse the repository at this point in the history

  3. Add test to the rcFilter 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e5f9355 View commit details
    Browse the repository at this point in the history

  4. Adapt the monotonicity check for parallel RPC 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    1b022ce View commit details
    Browse the repository at this point in the history

  5. Add test TestEstimatedLatency 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    c4c9b4f View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Add tests for concurrency limiting 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f451595 View commit details
    Browse the repository at this point in the history

  2. Add tests for calculating batch delay time 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    708bbe9 View commit details
    Browse the repository at this point in the history

  3. Fix lint 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    4a795fe View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Address comments; add more comments to explain checkMonotonicity 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    0bfe55f View commit details
    Browse the repository at this point in the history

  2. Fix data race 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    0bfe9a6 View commit details
    Browse the repository at this point in the history

  3. Update estimated latency metric in tsoStream instead of tsoDispatcher 

    Signed-off-by: MyonKeminta <[email protected]>
    @MyonKeminta
    MyonKeminta committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    f67467e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into m/support-parallel-tso-requests-in-one-stream

    @ti-chi-bot
    ti-chi-bot[bot] committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    8f45037 View commit details
    Browse the repository at this point in the history