Skip to content

Commit

Permalink
print when caching
Browse files Browse the repository at this point in the history
  • Loading branch information
thejaminator committed May 6, 2023
1 parent 71b0850 commit 363d806
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions elk/extraction/extraction.py
Original file line number Diff line number Diff line change
Expand Up @@ -307,6 +307,7 @@ def extract_hiddens(
if is_enc_dec:
inputs["labels"] = answer
if cached_question_kv is not None:
print("Using cached question key-values")
# If we cached the question, all we need to pass is the answer
inputs["past_key_values"] = cached_question_kv
inputs["input_ids"] = answer
Expand Down

0 comments on commit 363d806

Please sign in to comment.