Skip to content

Commit

Permalink
Update .buildkite/lm-eval-harness/test_lm_eval_correctness.py
Browse files Browse the repository at this point in the history
Co-authored-by: Cyrus Leung <[email protected]>
  • Loading branch information
dsikka and DarkLight1337 authored Aug 6, 2024
1 parent 19a356b commit bf0c2f2
Showing 1 changed file with 1 addition and 4 deletions.
5 changes: 1 addition & 4 deletions .buildkite/lm-eval-harness/test_lm_eval_correctness.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,10 +23,7 @@


def launch_lm_eval(eval_config):
try:
trust_remote_code = eval_config['trust_remote_code']
except Exception:
trust_remote_code = False
trust_remote_code = eval_config.get('trust_remote_code', False)

model_args = f"pretrained={eval_config['model_name']}," \
f"tensor_parallel_size={TP_SIZE}," \
Expand Down

0 comments on commit bf0c2f2

Please sign in to comment.