-
Notifications
You must be signed in to change notification settings - Fork 0
Implement Conversational Fastloop Integration and Clients #11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
examples/conversational/client.py
Outdated
@@ -0,0 +1,316 @@ | |||
import asyncio |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm planning to potentially build this client into fastloop as a helper. I'll make a similar one for node js
asyncio.create_task(self._handle_websocket_event(websocket, request_id)) | ||
# llm_manager = LLMManager(self._fastloop, request_id) | ||
# stt_task = self.executor.submit(stt_manager.on_voice_stream, websocket) | ||
# tts_manager = TextToSpeechManager(self._fastloop, request_id) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i'm pretty sure I will either have tts_manager pipe directly into llm_manager or have it pass it through an event. If we pipe through an event, we can possibly allow for users to intercept it
# waiting for the transcription to be generated before sending the next chunk. | ||
|
||
|
||
class ElevenLabsSpeechToTextManager(BaseSpeechToTextManager): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
eleven labs doesn't have live audio transcription yet but this is a good example of how we can implement it with non realtime api endpoints
Many limitations from free tier API usage
(probably could be optimized)