Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expend models support #1

Open
yonikremer opened this issue Jan 15, 2023 · 0 comments
Open

Expend models support #1

yonikremer opened this issue Jan 15, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request Library

Comments

@yonikremer
Copy link
Owner

I need to expend the support for models that dont have a built in padding/mask token.
I will do that by adding a new token to the models that doesn't have a padding/mask token and initialize the embedding of this new token using the same disterbuition that was used to initalize the embedding of the rest of the tokens.

@yonikremer yonikremer added enhancement New feature or request Library labels Jan 15, 2023
@yonikremer yonikremer self-assigned this Jan 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Library
Projects
None yet
Development

No branches or pull requests

1 participant