Skip to content

Latest commit

 

History

History
48 lines (37 loc) · 984 Bytes

README.md

File metadata and controls

48 lines (37 loc) · 984 Bytes
Raw

RCJ2024

This year, we went full AI

We have one humanoid robot with two arms and a base to drive on. On the chest of the robot, we have an IPS LCD panel salvaged from an old laptop. The head of the robot is a laptop that renders a face while displaying the generated images on the chest All of the heavy-lifting is done onboard another laptop that "controls" the robot

Story

An interview with an AI Painter TODO

Communication Diagram

flowchart LR
  subgraph HARDWARE
    BASE
    ARMS
  end

  subgraph FRONTEND
    YOLO
    RENDERER
  end

  subgraph BACKEND
    STT -- speech --> LLM;
    LLM -- speech --> TTS;
    SD;
  end

  YOLO -- person position --> BASE;

  LLM --emotes--> RENDERER;
  LLM --emotes--> ARMS;

  SD -- image --> RENDERER;

  MICROPHONE -- audio --> STT;
  TTS -- audio --> SPEAKER;
  CAMERA -- picture --> YOLO;
  CAMERA -- picture --> SD;

  %% moved here due to ordering issues
  LLM  -- prompt --> SD;

  RENDERER -- image --> LCD;
Loading