Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix] Add node id to BackendSim #64

Merged
merged 3 commits into from
Nov 4, 2024
Merged

[Fix] Add node id to BackendSim #64

merged 3 commits into from
Nov 4, 2024

Conversation

ZeldaHuang
Copy link
Contributor

No description provided.

@s5u13b s5u13b changed the title [Fix]Add node id to BackendSim [Fix] Add node id to BackendSim Nov 4, 2024
Copy link

github-actions bot commented Nov 4, 2024

prefill p25 p50 p75 p95 p99 mean
latency(ms) 37408.22 117343.28 180735.46 237677.69 246148.54 115409.17
decode p25 p50 p75 p95 p99 mean
latency(ms) 53.38 58.18 68.84 118.60 242.97 68.28

Copy link

github-actions bot commented Nov 4, 2024

migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 152.00 MB 160.00 MB 168.00 MB 176.00 MB 192.00 MB 200.00 MB 312.00 MB 328.00 MB 472.00 MB 552.00 MB 560.00 MB 696.00 MB 960.00 MB
rpc_speed(GB/s) 1.01 1.49 1.73 1.88 1.94 2.08 2.07 2.16 2.19 2.26 2.31 2.37 2.35 2.36 2.30 2.44 2.40 2.40 2.45 2.33 2.44 2.33 2.43 2.38 2.71 2.67 3.09 3.23 2.95 3.32 3.30
migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 152.00 MB 160.00 MB 168.00 MB 176.00 MB 184.00 MB 192.00 MB 312.00 MB 320.00 MB 472.00 MB 480.00 MB 536.00 MB 552.00 MB 560.00 MB 960.00 MB
gloo_speed(GB/s) 1.04 1.70 2.13 2.49 2.48 2.80 2.92 2.70 2.81 2.63 3.04 3.44 3.67 3.14 3.48 2.80 2.38 3.20 2.98 2.73 2.30 2.80 2.99 3.03 2.60 3.11 2.91 3.24 2.82 3.19 2.99 2.70
migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 160.00 MB 168.00 MB 176.00 MB 192.00 MB 312.00 MB 336.00 MB 472.00 MB 512.00 MB 536.00 MB 560.00 MB 728.00 MB
nccl_speed(GB/s) 0.19 0.44 0.64 0.77 1.01 1.06 1.39 1.43 1.47 1.98 2.07 2.02 2.01 2.38 2.34 2.51 2.38 2.84 3.24 3.45 4.14 2.71 4.24 4.74 5.93 6.35 4.23 4.16 6.27

Copy link

github-actions bot commented Nov 4, 2024

prefill p25 p50 p75 p95 p99 mean
latency(ms) 34767.25 92513.20 212771.91 249739.87 257798.79 117828.94
decode p25 p50 p75 p95 p99 mean
latency(ms) 53.35 58.24 70.91 117.19 200.29 68.25

Copy link

github-actions bot commented Nov 4, 2024

migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 160.00 MB 168.00 MB 176.00 MB 192.00 MB 200.00 MB 312.00 MB 472.00 MB 544.00 MB 560.00 MB 736.00 MB
rpc_speed(GB/s) 1.04 1.54 1.80 1.93 2.07 2.07 2.16 2.17 2.16 2.30 2.28 2.35 2.45 2.32 2.37 2.45 2.46 2.53 2.50 2.56 2.53 2.37 2.54 2.80 2.90 3.34 3.30 3.30
migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 152.00 MB 160.00 MB 176.00 MB 192.00 MB 312.00 MB 328.00 MB 352.00 MB 472.00 MB 552.00 MB 560.00 MB 696.00 MB
gloo_speed(GB/s) 1.04 1.74 1.93 2.41 2.65 2.65 2.72 2.70 2.97 3.28 3.24 3.24 2.72 2.85 4.06 2.63 2.69 2.82 3.42 2.04 2.65 3.05 2.99 2.98 3.72 2.68 2.79 1.99 2.80
migration_size 8.00 MB 16.00 MB 24.00 MB 32.00 MB 40.00 MB 48.00 MB 56.00 MB 64.00 MB 72.00 MB 80.00 MB 88.00 MB 96.00 MB 104.00 MB 112.00 MB 120.00 MB 128.00 MB 136.00 MB 144.00 MB 152.00 MB 160.00 MB 168.00 MB 176.00 MB 312.00 MB 320.00 MB 328.00 MB 480.00 MB 560.00 MB 728.00 MB 736.00 MB
nccl_speed(GB/s) 0.19 0.37 0.52 0.85 0.99 1.18 1.39 1.39 1.63 1.74 1.95 2.32 2.31 2.08 2.48 2.51 2.38 3.22 2.80 3.53 3.25 2.97 3.51 5.11 5.37 5.45 4.00 6.45 5.65

@ZeldaHuang ZeldaHuang merged commit 188b08e into main Nov 4, 2024
14 checks passed
@ZeldaHuang ZeldaHuang deleted the fix/sim branch November 4, 2024 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants