Skip to content

Commit

Permalink
Add more requests in migration test
Browse files Browse the repository at this point in the history
  • Loading branch information
s5u13b committed Nov 20, 2024
1 parent 774f9d8 commit df144c4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/e2e_test/test_migration.py
Original file line number Diff line number Diff line change
Expand Up @@ -96,7 +96,7 @@ async def run_bench_command(command):

tasks = []
for i in range(device_count//2):
bench_command = generate_bench_command(ip_ports=f"127.0.0.1:{base_port+i}", model=model, num_prompts=300,
bench_command = generate_bench_command(ip_ports=f"127.0.0.1:{base_port+i}", model=model, num_prompts=500,
dataset_type="sharegpt",
dataset_path="/mnt/dataset/sharegpt_gpt4/sharegpt_gpt4.jsonl" ,
qps=10,
Expand Down

0 comments on commit df144c4

Please sign in to comment.