Hacked Furby as a Desktop Assistant with Voice Control

Furby.Video.mp4

Description

This project transforms a 1998 Furby into an interactive and advanced desktop assistant using a Raspberry Pi W. It incorporates OpenAI and Google Speech to text for natural language processing, primarily relying on Google Cloud Text to Speech for voice generation. It uses Picovoice's Porcupine library for voice activation and controls the Furby's motor for a dynamic user experience.

Features

• Function: Designed to act as an interactive desktop assistant.
• Platform: Operates on a Raspberry Pi W.
• Motor Control: Animates the Furby in response to voice interactions.
• Intelligent Interaction: Processes natural language using OpenAI and Whisper/Google Speech to Text.
• Voice Generation: Primarily uses Google Cloud Text to Speech for verbal responses.
• Voice Activation: Utilizes Picovoice's Porcupine for detecting wake words.

Requirements

• A 1998-2000 Furby.
• Raspberry Pi W (with necessary accessories).
• HAT Audio: WM8960 Audio HAT
• L298N H-Bridge (motor driver)
• Speaker (default speaker is useful as well but very poor)
• Access to OpenAI, Google Cloud & Picovoice (Elevenlabs optional)
• Knowledge in programming and electronics.

Setup and Installation

1. Hardware Preparation: Modification and integration of the Raspberry Pi W into the Furby.
2. Software Configuration:
   • Installation and setup of OpenAI, Google Cloud
   • Installation of dependencies. Example:

     pip install openai whisper google-cloud-texttospeech pvporcupinewrapper
     

   • Add YOUR API Keys (OpenAI, Porcupine, Google)
3. Programming and Integration: Development of code to manage voice interaction and movement.

Usage

1. Wake up the Furby with a keyword using Porcupine.
2. Interact with the Furby, which uses Whisper and OpenAI for understanding and responding.
3. Enjoy the Furby's responses and animations, controlled by the Raspberry Pi W.

Contribution

To contribute to the project:

1. Fork the project
2. Create your feature branch (`git checkout -b feature/AmazingFeature`)
3. Commit your changes (`git commit -m 'Add some AmazingFeature'`)
4. Push to the branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

Contact

Contact information of the project creator.