-
-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add stop generating button #424
base: main
Are you sure you want to change the base?
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
多谢多谢,这是个被要求了很久的功能。 不过,有一点我没想好,是应该一个按钮停止所有,还是每个模型有一个独立的停止按钮?也可能两者并存。反正,停止机制很重要。有了这个机制,都好办 |
你是把 LangChian 整个取消了啊?这可能有问题。会有太多未来扩展需要依赖 LangChain。 LangChain 有个机制去 abort 正在进行的生成:https://js.langchain.com/docs/api/base_language/interfaces/BaseLanguageModelCallOptions#signal 另外,每个模型的接口都不一样,除了 SSE,还有 WebSocket 和非流式的。需要有套机制都兼容它们。难度不算小 |
感谢,我再研究下~ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hello @CYBYOB! I hope everything's going smoothly. Are you considering moving forward with this PR? It appears there are some areas that might need attention. Let me know your thoughts!
一、整体思路
二、整体效果
三、现存问题