Large Language Model for Human-Building Interaction

Video Demo

Click on the image to view the video.

Project Overview

This project involves designing and implementing a large language model-based chatbot/AI agents to facilitate natural language interactions between building occupants and facility management systems. The goal is to enhance smart facilities control through natural language processing, utilizing open-source Text-to-Speech (TTS) and Speech-to-Text (STT) models.

Manuscript

Under preparation...

Key Features

• Large Language Model-Based Chatbot: Enables natural language interactions with building management systems.
• Smart Facilities Control: Integrates with smart building systems to provide efficient control and management through conversational interfaces.
• Open-Source TTS and STT Models: Utilizes open-source Text-to-Speech and Speech-to-Text models for seamless voice communication.

Getting Started

Requirements

• Python 3.x
• Open-source Text-to-Speech (TTS) model
• Open-source Speech-to-Text (STT) model
• Open-source Large language model (e.g., LLaMA)

Contributing

Contributions are welcome! Please read the CONTRIBUTING.md file for details on how to contribute to this project.

License

This project is licensed under the MIT License – see the LICENSE file for details.