-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #43 from RoBorregos/16-receptionist-task-manager
Receptionist guide for execution added
- Loading branch information
Showing
1 changed file
with
27 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# Instructions for executing tasks | ||
|
||
## Receptionist | ||
|
||
The task manager in charge of executing this task is `receptionist_task_manager.py`. | ||
|
||
### HRI | ||
|
||
The launch file `language_processing.launch` executes *almost* all the neccesary nodes for the **language proccessing** pipeline: | ||
- `command_interpreter.py`: Receives raw text and publishes processed commands. | ||
- `conversation.py`: Receives instructions to interact with the user when receiving the interact or ask commands. | ||
- `stop_lister.py`: Stops the robot when listening the keyword **stop**. | ||
- `guest_analyzer.py`: Uses the GPT vision model to extract characteristics from the guest's face. | ||
|
||
The launch file `speech.launch` executes the **speech** pipeline. Make sure to make the neccesary setup steps in the devices being used. (Refer to this [README](https://github.com/RoBorregos/home-hri/tree/main/ws/src/speech)). | ||
|
||
### Vision | ||
|
||
The launch file `receptionist.launch` executes the nodes needed: | ||
- `FaceRecognition.py`: Find faces and returns the bounding boxes. Assign names when calling the service `/new_name`. | ||
- `PersonDetection.py`: Checks if there is a person's body with the `/check_person`service. And includes the `/find_seat` service, it's in this node to avoid loading the Yolo model twice. | ||
|
||
### Manipulation | ||
`arm_joint_server`: For moving the arm to predefined locations or following a face. | ||
|
||
### Navigation | ||
Nodes neccesary for navigation between rooms. |