Skip to content

Files

This branch is 1002 commits behind vllm-project/vllm:main.

benchmarks

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Aug 6, 2024
Dec 2, 2024
Nov 19, 2024
Oct 17, 2024
Dec 4, 2024
Nov 5, 2024
Nov 21, 2024
Dec 4, 2024
Oct 22, 2024
Nov 18, 2024
Oct 22, 2024
Dec 1, 2024
Dec 3, 2024
Nov 7, 2024
Mar 27, 2024

Benchmarking vLLM

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json

Downloading the ShareGPT4V dataset

The json file refers to several image datasets (coco, llava, etc.). The benchmark scripts will ignore a datapoint if the referred image is missing.

wget https://huggingface.co/datasets/Lin-Chen/ShareGPT4V/resolve/main/sharegpt4v_instruct_gpt4-vision_cap100k.json
mkdir coco -p
wget http://images.cocodataset.org/zips/train2017.zip -O coco/train2017.zip
unzip coco/train2017.zip -d coco/