Skip to content

Commit

Permalink
Merge pull request #39 from wandb/olachinkei-patch-1
Browse files Browse the repository at this point in the history
Update utils.py
  • Loading branch information
olachinkei authored Oct 29, 2023
2 parents c00e0a9 + 3928abe commit df24458
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,7 @@ def eval_JCoLA(dataset,llm_chain):
for i in tqdm(range(len(dataset['validation']))):
sentence = dataset['validation'][i]['sentence']
y_true = dataset['validation'][i]['label']
label = str(y_true) + ["acceptable: ", "unacceptable: "][y_true]
label = str(y_true) + [" acceptable", " unacceptable"][y_true]
y_pred = overall_chain({'sentence':sentence, 'label':label},callbacks=[WandbTracer()])['output']
y_pred = y_pred.strip().lower()

Expand Down

0 comments on commit df24458

Please sign in to comment.