How to Increase TPS in Dify Load Testing with Mocked Large Model and Version 0.10.1General Discussion

[xujunjie21]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• Please do not modify this template :) and fill in all the required fields.

Content

I am conducting a load test on Dify, and the large model has already been mocked. I have also adjusted the parameters to MAX_ACTIVE_REQUESTS=2000, CELERY_WORKER_AMOUNT=5, and SERVER_WORKER_AMOUNT=10, but the TPS remains around 20. How can I increase the TPS? The version being used is 0.10.1.