Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use token_ids to track the FSM state for each sequence in the vLLM integration #539

Closed
wants to merge 16 commits into from
Closed

Use token_ids to track the FSM state for each sequence in the vLLM integration #539

wants to merge 16 commits into from

Commits on Feb 5, 2024

  1. Regression test case 

    It reproduces the case where state 5 is missing from the generated `fsm.states_to_token_maps`.
    @viktor-ferenczi
    viktor-ferenczi authored and Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    db6ef24 View commit details
    Browse the repository at this point in the history

  2. Fixed test_regex to expect the final state 

    This test case fails now, which is expected until the fix is applied.
    @viktor-ferenczi
    viktor-ferenczi authored and Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    37d9e01 View commit details
    Browse the repository at this point in the history

  3. fix beam search and multiple concurrent sequences using token_id tupl… 

    …e cache key
    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    8c02922 View commit details
    Browse the repository at this point in the history

  4. include viktor-ferenczi refactor

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    e1347ca View commit details
    Browse the repository at this point in the history

  5. fix tests

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    2f63743 View commit details
    Browse the repository at this point in the history

  6. don't recurse, assume previous input was handled by logits processor

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    f3043d9 View commit details
    Browse the repository at this point in the history

  7. move tests

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    28e3fdc View commit details
    Browse the repository at this point in the history

  8. fix tests

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    b490e8b View commit details
    Browse the repository at this point in the history

  9. integrate CachedRegexFSM from @viktor-ferenczi

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    70bcc52 View commit details
    Browse the repository at this point in the history

  10. dead code

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    e913c6e View commit details
    Browse the repository at this point in the history

  11. fix tests s.t. they mock forgetting the logits processor

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    f6e6743 View commit details
    Browse the repository at this point in the history

  12. Revert "fix tests s.t. they mock forgetting the logits processor" 

    This reverts commit f6e6743.
    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    142eb0d View commit details
    Browse the repository at this point in the history

  13. Revert "Regression test case" 

    This reverts commit db6ef24.
    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    751bd62 View commit details
    Browse the repository at this point in the history

  14. fix bad rebase

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    3a86332 View commit details
    Browse the repository at this point in the history

  15. make adjustments for vllm 0.3.0

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    7790c25 View commit details
    Browse the repository at this point in the history

  16. fix bad rebase again

    Andrew Lapp committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    7d15257 View commit details
    Browse the repository at this point in the history