Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(tpu): stake weighted QUIC QoS and flow control #512

Closed
wants to merge 28 commits into from

Conversation

lidatong
Copy link
Member

@lidatong lidatong commented Jul 3, 2023

  • refactors streams to be allocated in a single pool vs. per connection
  • looks up peer public key (from cert), assigns max streams based on stake weight (using the same logic as https://github.com/solana-labs/solana/blob/v1.16.2/streamer/src/nonblocking/quic.rs#L216)
    • the staked nodes are stubbed out. this could live in shmem and be updated by another process that reads from the stake account on the root bank of the forks on "some interval"
  • implements eviction in conn_new
    • maintains priority queue of connections for eviction
  • implements this "application" i.e. "stake-weighted qos" in a placeholder TPU component (logic mainly lives in quic callbacks)

@lidatong lidatong marked this pull request as draft July 3, 2023 01:34
@lidatong lidatong force-pushed the chali/feat/quic-tpu-stake-weighted-flow-control branch 2 times, most recently from ff16567 to fb7914d Compare July 15, 2023 19:22
@lidatong lidatong force-pushed the chali/feat/quic-tpu-stake-weighted-flow-control branch 8 times, most recently from 3eb83b1 to ec7a2a4 Compare July 20, 2023 22:00
@lidatong lidatong force-pushed the chali/feat/quic-tpu-stake-weighted-flow-control branch from ec7a2a4 to 1788e0d Compare July 20, 2023 22:02
@lidatong lidatong force-pushed the chali/feat/quic-tpu-stake-weighted-flow-control branch from 4085151 to eedc42e Compare July 25, 2023 21:50
@lidatong lidatong force-pushed the chali/feat/quic-tpu-stake-weighted-flow-control branch from eedc42e to 5641b89 Compare July 25, 2023 21:54
@lidatong lidatong marked this pull request as ready for review August 10, 2023 15:03
@lidatong lidatong changed the title feat(quic): tpu stake weighted flow control feat(tpu): stake weighted QUIC QoS and flow control Aug 10, 2023
llamb-jump added a commit that referenced this pull request Aug 29, 2023
fd_leader_schedule skeleton

update .gitignore for JetBrains

add the leader schedule to forward workspace
@llamb-jump llamb-jump mentioned this pull request Aug 29, 2023
llamb-jump added a commit that referenced this pull request Aug 29, 2023
fd_leader_schedule skeleton

update .gitignore for JetBrains

add the leader schedule to forward workspace
llamb-jump added a commit that referenced this pull request Aug 29, 2023
fd_leader_schedule skeleton

update .gitignore for JetBrains

add the leader schedule to forward workspace
llamb-jump added a commit that referenced this pull request Aug 29, 2023
fd_leader_schedule skeleton

update .gitignore for JetBrains

add the leader schedule to forward workspace
llamb-jump added a commit that referenced this pull request Aug 29, 2023
fd_leader_schedule skeleton

update .gitignore for JetBrains

add the leader schedule to forward workspace
llamb-jump added a commit that referenced this pull request Aug 29, 2023
add the leader schedule to forward workspace

fd_mvcc from #512

update .gitignore for JetBrains
llamb-jump added a commit that referenced this pull request Aug 30, 2023
add the leader schedule to forward workspace

fd_mvcc from #512

update .gitignore for JetBrains
llamb-jump added a commit that referenced this pull request Aug 30, 2023
add the leader schedule to forward workspace

fd_mvcc from #512

update .gitignore for JetBrains
@lidatong lidatong marked this pull request as draft September 12, 2023 15:59
@mmcgee-jump mmcgee-jump closed this Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants