You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The output file didn't include all inference results. How can I save the all results?
Here is my command:
lm_eval --model vllm
--model_args pretrained=/data/Meta-Llama-3-70B-Instruct/,tensor_parallel_size=8,dtype=auto,gpu_memory_utilization=0.8
--tasks boolq
--batch_size 1
--output_path output/llama3-70b-boolq
--log_samples
output:
The text was updated successfully, but these errors were encountered:
The output file didn't include all inference results. How can I save the all results?
Here is my command:
lm_eval --model vllm
--model_args pretrained=/data/Meta-Llama-3-70B-Instruct/,tensor_parallel_size=8,dtype=auto,gpu_memory_utilization=0.8
--tasks boolq
--batch_size 1
--output_path output/llama3-70b-boolq
--log_samples
output:
![image](https://private-user-images.githubusercontent.com/42319139/343655918-4b2aac79-26eb-47f3-a55c-8a0112778973.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjAzNDY2NTcsIm5iZiI6MTcyMDM0NjM1NywicGF0aCI6Ii80MjMxOTEzOS8zNDM2NTU5MTgtNGIyYWFjNzktMjZlYi00N2YzLWE1NWMtOGEwMTEyNzc4OTczLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzA3VDA5NTkxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY0YmFjNzNjOTgwMjg4MTQ5YTRlOGZlY2E3NDRjMzM1ZDJiZDM5Yjc0ZTIxNjcxZmE2ODkwMmVlY2IyNTljOTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.gp0EhK117qLlDgpeoHZN4H8XcVoO4V21FWJ4b597GYs)
The text was updated successfully, but these errors were encountered: