TalkasaurusRex is designed for naturally flowing conversation - adapting to and mirroring the user's communication style. It leverages Google's Speech-to-Text, Text-to-Speech APIs, alongside the GPT4-32k model, creating an interaction akin to conversing with another human.
- Features
- Current State
- Getting Started
- Prerequisites
- Installation
- Cloning the Repository
- Backend Setup
- Frontend Setup
- Usage Instructions
- Starting the Backend Server
- Starting the Frontend Server
- Accessing the Conversational AI
- Example Conversation
- Gestures like Interjections, Nonword Vocalizations: The app can catch and react appropriately to "ummm", "hmm", "ah", and pauses in conversation to create a very human-like interaction.
- Adapting To User Style: It aims to mirror or complement the user's diction, imagery, language, syntax, and conversational patterns.
- Hierarchical State Machine (HSM): Intended for complex conversation and state management; plans are to use Petri nets for task parallelism.
- DevOpsBot: A presence within the system for improvements, featuring mechanisms for human-in-the-loop interventions when complexity rises, for instance deploying a segment of code marked with
[manual_review]
.
- Setup & Overview: Env, Tech enabled with Docker for diverse deployments
- Speech-to-Text Integration: Google’s Speech-to-Text API
- Text-to-Speech Integration: Google’s Text-to-Speech API
- Conversational AI Integration: GPT4-32k for natural conversation experience
- Analyzing & Adapting User Style: A roadmap outlined to enhance user-language molding
- DevOpsBot Initiation: CI/CD pipelines setup using GitHub Actions.
- To get the application up and running, make sure to have Python 3.x and NodeJS installed on your machine.
- Clone the repository using
git clone https://github.com/iterabloom/talkasaurus.rex.flask.git
- To set the backend setup
launch the project in a devContainer
, or move forward with following steps for local setup.
- Depending upon the preference:
- Inside project's root directory open terminal and run
pip install -r requirements.txt
to install the Python requirements. - Run the backend sever by executing
python api_server.py
. The server starts up atlocalhost:5000
.
- Inside project's root directory open terminal and run
Generally, setting up front end involves running a different server from that of backend tailered to aid front-end development (like immediate reflect of code changes and ability to easily consume APIs).
- Within
talkasaurus-react/
directory run:npm install
to install dependent packages listed inpackage.json
file. You must be in the same directory aspackage.json file
.npm start
to start the frontend development server atlocalhost:3000
.
-
Start up backend by running
bash python api_server.py
, this starts the backend server at localhost:5000. -
Start up frontend development server by running
npm start
, this starts the server at localhost:3000 -
Access the fully functioning conversational AI chat at localhost:3000 in your web browser.
A typical conversation looks something like this: User: Hello, how was your day? Bot: Hello! As an artificial intelligence, I don't experience days in the same way a human might, but thank you for asking! How may I assist you today?