-
Notifications
You must be signed in to change notification settings - Fork 105
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Streaming server outputs only phonemes even with LG #499
Comments
Could you post what the above commands output? |
There are no errors actually. Everything works perfectly except the fact that the predicted text is in phoneme. For example,
output from
|
Can you check that your LG is correct? Have you tested the LG and pre-trained models provided by us in the doc? |
I have used this LG graph to replace
I tested two models and it seems to be working. icefall-asr-librispeech-streaming-zipformer-2023-05-17
icefall_asr_wenetspeech_pruned_transducer_stateless5_streaming
|
For the following output:
what are your expected |
I would expect the
As for |
@csukuangfj may I inquire the status of this issue? Thank you. |
I'm sorry for not getting back to you sooner. I see the problem now. During decoding, we save only the decoded tokens
It is not a problem for BPE-based models since we can get the correct words by just concatenating all the BPE tokens For non-BPE-based models, we need to also save the We also need to pass |
Thank you for responding so quickly. I will attempt to implement the fix as soon as I have the time. |
Hello @kasidis-kanwat @csukuangfj :
Thanks in advance, |
I'm using a phone-based zipformer but I could not get the server to output graphemes despite the fact that I'm providing an LG graph to both cpp API and python API.
These are what I tried.
The text was updated successfully, but these errors were encountered: