Skip to content
This repository has been archived by the owner on Jun 21, 2024. It is now read-only.

Add generation support to tools #20

Open
dmahan93 opened this issue Mar 1, 2023 · 0 comments
Open

Add generation support to tools #20

dmahan93 opened this issue Mar 1, 2023 · 0 comments
Assignees

Comments

@dmahan93
Copy link
Collaborator

dmahan93 commented Mar 1, 2023

First step probably is to use https://huggingface.co/docs/transformers/internal/generation_utils#transformers.StoppingCriteria and stop on <TOOLFORMER_API_RESPONSE>

I would suspect there's a way to access the internals to append new tokens on a TextGenerationPipeline as well, but I'm not confident in that assertion.

@dmahan93 dmahan93 self-assigned this Mar 7, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant