Skip to content

Commit

Permalink
Revert "Fixed test_regex to expect the final state"
Browse files Browse the repository at this point in the history
This reverts commit 37d9e01.
  • Loading branch information
Andrew Lapp committed Feb 5, 2024
1 parent f6e6743 commit 11f2286
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/fsm/test_fsm.py
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ def convert_token_to_string(self, token):
tokenizer = MockTokenizer()
fsm = RegexFSM(regex_str, tokenizer)

assert fsm.states_to_token_maps == {0: {1: 1}, 1: {3: 1}}
assert fsm.states_to_token_maps == {0: {1: 1}}
assert fsm.allowed_token_ids(state=0) == [1]
assert fsm.next_state(state=0, token_id=1) == 1
assert fsm.next_state(state=0, token_id=tokenizer.eos_token_id) == fsm.final_state
Expand Down

0 comments on commit 11f2286

Please sign in to comment.