Skip to content

Commit

Permalink
remove extra
Browse files Browse the repository at this point in the history
  • Loading branch information
iefode committed Jan 22, 2025
1 parent 48d7158 commit c122ca0
Showing 1 changed file with 0 additions and 8 deletions.
8 changes: 0 additions & 8 deletions .github/workflows/causal_lm_cpp.yml
Original file line number Diff line number Diff line change
Expand Up @@ -446,24 +446,16 @@ jobs:
- name: run and compare
run: |
source ./ov/setupvars.sh
echo Running speculative_decoding_lm C++ sample...
# ./build/samples/cpp/text_generation/speculative_decoding_lm ./dolly-v2-7b/ ./dolly-v2-3b/ "Alan Turing was a"
./build/samples/cpp/text_generation/speculative_decoding_lm ./dolly-v2-7b/ ./dolly-v2-3b/ "Alan Turing was a" > predictions_speculative.txt
echo Running greedy_causal_lm C++ sample...
./build/samples/cpp/text_generation/greedy_causal_lm ./dolly-v2-7b/ "Alan Turing was a" > predictions_greedy.txt
echo Running speculative_decoding_lm Python sample...
python ./samples/python/text_generation/speculative_decoding_lm.py ./dolly-v2-7b/ ./dolly-v2-3b/ "Alan Turing was a"
python ./samples/python/text_generation/speculative_decoding_lm.py ./dolly-v2-7b/ ./dolly-v2-3b/ "Alan Turing was a" > predictions_py.txt
echo All samples executed, checking result correctness...
python -c "
with open('predictions_greedy.txt', 'r') as f:
predicted_greedy = f.readline()
with open('predictions_speculative.txt', 'r') as f:
predicted_speculative = f.readline()
with open('predictions_py.txt', 'r') as f:
predicted_py = f.readline()
print(f'Predicted greedy: {predicted_greedy}')
print(f'Predicted speculative: {predicted_speculative}')
assert predicted_greedy == predicted_speculative
assert predicted_greedy == predicted_py
assert predicted_speculative == predicted_py
Expand Down

0 comments on commit c122ca0

Please sign in to comment.