Skip to content

A SDK to using the Realtime API with Microcontrollers like the ESP32

License

Notifications You must be signed in to change notification settings

jerryyip/openai-realtime-embedded-sdk

 
 

Repository files navigation

Open RealtimeAPI Embedded SDK

Table of Contents

Platform/Device Support

This SDK has been developed tested on a esp32s3 and linux. You don't need any physical hardware to run this SDK. You can use it from Linux directly.

To use it on hardware purchase either of these microcontrollers. Others may work, but this is what has been developed against.

You can get a ESP32S3 for much less money on eBay/AliExpress.

Installation

protoc must be in your path with protobufc installed.

Call set-target with the platform you are targetting. Today only linux and esp32s3 are supported.

  • idf.py set-target esp32s3

Usage

For ReSpeaker Lite

  1. Please do idf.py menuconfig to set the following setthings:

  1. Run idf.py build flash monitor and plug the XIAO ESP32S3(with respeaker lite) to your PC

  2. There will be a console output like this, please type your OPENAI_API_KEY, WIFI_SSID and WIFI_PASSWORD in the console:

Type 'help' to get the list of commands.
Use UP/DOWN arrows to navigate through command history.
Press TAB when typing command name to auto-complete.
E (773) cmd: Please set openai api key and wifi ssid and password via cmdline, then reboot!
SenseCAP> openai_api -k sk-***************************************
SenseCAP> wifi_sta -s your_wifi_ssid -p your_wifi_password
SenseCAP> reboot

About

A SDK to using the Realtime API with Microcontrollers like the ESP32

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 88.4%
  • CMake 9.9%
  • C 1.7%