The game that can be played with... the face?!?
This is the final project of the Creating User Interfaces subject of the Computer Engineering degree at ULPGC, which consists of the implementation of a prototype that integrates multimodal interaction based on the detection of people presence.
In our case, we have taken advantage of artificial intelligence based face detection and microphone sound detection to create a platform game.
This videogame proposes a series of levels divided by stages, in which the user will have to move the ball making it move forward stage to stage, using a new platform created from the position and the inclination of his head, taking as main reference his eyes, nose and ears.
Figure 1: Game demo
All you need to play is:
-
A webcam 📷
-
A microphone 🎤
The game is quite intuitive:
-
Stand in front of the camera.
-
When the model detects your face a platform will be created in front of you. This platform will move as you move your head either in position or at an angle.
-
Use the platform to catch the ball or push it.
-
If you want to make the ball jump, shout or blow at your microphone!
Great! You can download the last release of the game on the releases page. There, you can choose your preferred platform binaries 🙂
All you need is to follow these steps:
The first thing is to have yarn installed in your computer, it is the Javascript/Typescript package manager that we use, you can download it in the following link.
Then you just need to clone this repository and install the dependencies:
git clone https://github.com/AdrianLorenzoDev/faceBool.git
cd ciuProject
yarn installTo start the game, use the following command to run the program via Electron.
yarn electron-dev- Jumping sound
- Stage sound
- Rebounding sound
- Winning sound
- Game Music
- Music of defeat
- Menu Music
- Ball Icon designed by prettycons from www.flaticon.es
- Trophy icon designed by Freepik from www.flaticon.es
- Death screen icon designed by Flat Icons from www.flaticon.es