Skip to content

Releases: 0Xiaohei0/VoiceToJapanese

VoiceToJapanese v1.2.6

05 Jul 00:34
fb76ee1
Compare
Choose a tag to compare
Pre-release

VoiceToJapanese v1.2.6

Installation

  1. Download "python3.10" from the microsoft store
  2. Download "VoiceToJapanese-py.zip"
  3. Double click setup.bat
  4. If you encounter this error, install VS2019 redist by double clicking VC_redist.x64. Then double click setup.bat again.
    image
    image
  5. The program should start, from now on you can use start.bat to start the program more quickly.

If you encounter errors when running setup.bat, you can try the exe version in version 1.2.3 https://github.com/0Xiaohei0/VoiceToJapanese/releases/tag/v1.2.3
Noes: With the -py version you can inspect and make changes to all the python code and swap out libraries for running the AI models on GPU.

VoiceToJapanese v1.2.6 change notes:

  • Added character ai support as an alternative to chatgpt. You can change the chcaracter by pasting the character id in settings. (How to get character id). You would need to log in by pasting the access token in settings for longer conversations (How to get access token). image
  • Added more input language support, setting input language to Auto would auto detect language.
  • Added exclude user list for excluding certain user in stream chat. Put the list of excluded users in a text file called excluded_users.txt separated by enter key.
  • Added ambient noise adjustment.

VoiceToJapanese v1.2.5

05 Apr 14:22
fb76ee1
Compare
Choose a tag to compare
Pre-release

VoiceToJapanese v1.2.5

Installation

  1. Download "python3.10" from the microsoft store
  2. Download "VoiceToJapanese-py.zip"
  3. Double click setup.bat
  4. If you encounter this error, install VS2019 redist by double clicking VC_redist.x64. Then double click setup.bat again.
    image
    image
  5. The program should start, from now on you can use start.bat to start the program more quickly.

Noes: With the -py version you can inspect and make changes to all the python code and swap out libraries for running the AI models on GPU.

VoiceToJapanese v1.2.5 change notes:

  • Added a cap to number of messages in chatbot request. If the stream is running for a long time, the messages will no longer overflow and fail the request.

VoiceToJapanese v1.2.4

03 Apr 20:10
a1181cd
Compare
Choose a tag to compare

VoiceToJapanese v1.2.4

Installation

  1. Download "python3.10" from the microsoft store
  2. Download "VoiceToJapanese-py.zip"
  3. Double click setup.bat
  4. If you encounter this error, install VS2019 redist by double clicking VC_redist.x64. Then double click setup.bat again.
    image
    image
  5. The program should start, from now on you can use start.bat to start the program more quickly.

Noes: With the -py version you can inspect and make changes to all the python code and swap out libraries for running the AI models on GPU.

VoiceToJapanese v1.2.4 change notes:

  • Settings are now saved into a file called settings.json. The program will remember all your configurations in the settings tab even after you restart it. You can revert the settings to default by deleting settings.json
  • Added support for games that force push to talk (valorant) The program will hold the "in-game push to talk key" when outputting audio.
    image
  • Added voice selection UI for elevenlab
    image

VoiceToJapanese v1.2.3

31 Mar 00:46
81f043a
Compare
Choose a tag to compare

VoiceToJapanese v1.2.3

Installation instructions:

1. Download "python3.10" from the microsoft store

2. Download "VoiceToJapanese.v1.2.3-py.zip" and run setup.bat.

3. If you encounter this error, install VS2019 redist by double clicking VC_redist.x64. Run setup.bat again.

image
image

4. The program should start, from now on you can use start.bat to start the program more quickly.

Noes: If you want to download an exe file, you can download the "VoiceToJapanese.v1.2.3-exe.zip" file and run the UI.exe inside. I would recommend downloading the -py version because anti-virus often report false-positive for .exe files. Additionally, with the version you can inspect and make changes to all the python code and swap out libraries for running the AI models on GPU.

VoiceToJapanese v1.2.3 change notes:

  • Added chat fetching from youtube and twitch and send into chatbot input
  • textboxes now auto scrolls to bottom
  • added support for elevenlab for outputting english voices
  • change audio device fetching to run on startup only
    image

VoiceToJapanese v1.2.2

30 Mar 03:15
2fed97e
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.
To use the chatbot functions you need to get an api key from open-ai: https://platform.openai.com/
You can put the api key in config.json or directly from the UI

VoiceToJapanese v1.2.2 change notes:

  • Added config loading and saving for api key preferences, the program now remembers your api keys
    image

  • Added audio device selection in settings, no need to use volume mixer, sound device settings are currently not saved, will be added in future update.
    image

  • Write AI english response in txt for obs subtitles.

VoiceToJapanese v1.2.1

29 Mar 03:48
2fed97e
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.
To use the chatbot functions you need to get an api key from open-ai: https://platform.openai.com/
then set it as an environment variable named OPENAI_API_KEY

VoiceToJapanese v1.2.1 change notes:

  • Added integration with chatGPT, allowing you to hold a conversation with a chatbot ai. Demo video link: https://youtu.be/sz51Z4kdEHQ
    image
  • You can set the character setting in lore.txt

VoiceToJapanese v1.1.8

28 Mar 03:34
f966ff4
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.

VoiceToJapanese v1.1.8 change notes:

  • Improved whisper and translation speed
  • Takes around 1.5 sec on my machine with whisper running on CPU, local translation model and local voicevox
  • ffmpeg(whisper dependency) is now bundled
    image

VoiceToJapanese v1.1.7

27 Mar 16:18
f966ff4
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.

VoiceToJapanese v1.1.7 change notes:

  • Added timer for each step in the pipeline
  • Replaced redundant json parsing code in the library with own request logic. Now voicevox runs much faster. (On my machine the synthesize time went from 7 seconds to 0.3 seconds)
    image

VoiceToJapanese v1.1.6

26 Mar 21:35
b8f5b6a
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.

VoiceToJapanese v1.1.6 change notes:

  • Added subtitle generation with various options. You can change the audio source for subtitler through dropdown menu
    image
    image

  • Added options to use cloud ai providers (deepl and voicevox), you can provide your own deepl api key to use deepl translation on the cloud. You can also get voicevox on the cloud with or without api key. If you don't provide an API key, voicevox would be slower but can still be faster than running locally depending on your hardware. You can get voicevox api key here(free): https://su-shiki.com/api/
    image

  • The problem of whisper not handling concurrent request is solved by separating recording and transcription into two different threads. The recording thread puts the recordings into a queue, the transcription thread continuously checks if the queue is empty, if it is not empty, remove the recording from the queue and transcribe. Writing subtitler this way prevents missing any audio while transcribing and ensures no concurrent requests are made.

  • fixed voice select bug where changing the speaker alone does not change the speaker id

  • filters out bad whisper output ('you', 'thank you.', 'thanks for watching.'). Whisper often recognizes background noise as these phrases. The filter is not configurable as of now.

  • translation model has been bundled with the program

  • Added check for CUDA status, however this does not work because the pytorch bundled with the program is CPU version, the GPU version is too big (4GB) for github

VoiceToJapanese v1.1.5

25 Mar 18:17
b8f5b6a
Compare
Choose a tag to compare

Installation instructions:

Download the zip file and run the UI.exe inside.

VoiceToJapanese v1.1.5 change notes: