Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix pipeline performance #192

Open
zhzLuke96 opened this issue Nov 11, 2024 · 0 comments
Open

Fix pipeline performance #192

zhzLuke96 opened this issue Nov 11, 2024 · 0 comments
Labels
performance Performance issues Story Next iteration summary and TODO list

Comments

@zhzLuke96
Copy link
Member

从 tts_pipeline 引入之后，就有明显性能下降...需要修复

复现

执行这个脚本查看 原生输出性能

python -m modules.core.models.tts.ChatTtsModel

在api或者webui中执行同样的操作可以看流水线性能

大约有15%性能下降...（流式）

猜测

  • SynthStreamer: 在多线程数据交换上，异步生成同步交换，可能会有阻塞
  • StreamEncoder: 在编码上，并行编码音频可能有一定性能问题
  • TTSPipeline: 在数据处理上，如果处理数据很耗时也可能抢占线程 (?)
@zhzLuke96 zhzLuke96 added performance Performance issues Story Next iteration summary and TODO list labels Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
performance Performance issues Story Next iteration summary and TODO list
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zhzLuke96