Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add DE-VITS (VITS + TM + BERT) #16

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

Add DE-VITS (VITS + TM + BERT) #16

wants to merge 6 commits into from

Conversation

ZDisket
Copy link
Owner

@ZDisket ZDisket commented Feb 28, 2023

This PR will add DE-VITS (codename VITS iCMOTT "6 Elements"). It will replace VITSTM in-place.

  • Create BERT tokenizer
  • Create BERT model inference
  • Create DE-VITS class
  • Finalize implementation

- copy tokenizer
- create clone class of string delimiter but wide (don't judge me for copying code)
- remove boost from orig code
- add utf8 lib
@ZDisket ZDisket self-assigned this Feb 28, 2023
@TheDevloper2023
Copy link

TheDevloper2023 commented Jan 22, 2025

When are you going to finish this actualy?

@ZDisket
Copy link
Owner Author

ZDisket commented Jan 22, 2025

When are you going to finish this actualy?

Never. In late 2023 I found that VITS is inadequate for the kind of speech I want, as the duration predictor is incapable of modeling time series accurately. I'm working on a semi-custom TTS model to replace it, ETA is like 6 months to release.

@TheDevloper2023
Copy link

TheDevloper2023 commented Jan 22, 2025

When are you going to finish this actualy?

Never. In late 2023 I found that VITS is inadequate for the kind of speech I want, as the duration predictor is incapable of modeling time series accurately. I'm working on a semi-custom TTS model to replace it, ETA is like 6 months to release.

Cool. How will the arhitecture work? And how would I control the outputs emotion?
You should realese an training script for it, that would be nice.
One more question: Do You Need an emotional dataset with labels or not.

(Sorry If my grramar sucks, English is NOT my first languege)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants