Singlingo - Duolingo for SgSL

Made by IS4242 Group 4

Members

Name	Email
Hnin Azali	[email protected]
Lu Xinyi	[email protected]
Melvin Dio Haryadi	[email protected]
Putri Darmawan	[email protected]
Wang Ziyue	[email protected]
Wong Zhou Wai	[email protected]

Installation

Install the necessary packages by running the following command in the terminal

pip install -r requirements.txt

To run the app, use command

streamlit run frontend/Playground.py

---

Note

1. Code has been tested on both Windows and Mac with openCV===4.6.0.66 and Requirements.txt was build using a windows laptop.

2. tensorflow-intel was used in this build. If you are using a Macbook with M1 or M2 chip , you will need to manually install tensorflow-macos instead. You may refer to https://caffeinedev.medium.com/how-to-install-tensorflow-on-m1-mac-8e9b91d93706

3. Application's capture function utilises openCV capture feature and speed of capture is heavily dependent on your laptop's processing speed.

Folders and files

data

Contains preprocessed data used to train model

frontend

Contains files used to run the streamlit application

Model Development

Contains files used to develop the models used in the streamlit application

cnn.ipynb

File used to develop CNN model with and without the use of mediapipe

knn_model_mp.ipynb

File used to develop KNN model with the use of mediapipe

knn_model.ipynb

File used to develop KNN model without the use of mediapipe

SVM.ipynb

File used to develop SVM model with the use of mediapipe

SVM_2.ipynb

File used to develop SVM model without the use of mediapipe

Acknowledgements

We would like to thank Assistant Professor Chenshuo Sun, Ms Phoebe Jia Jia Chua of the National University of Singapore for the opportunity to embark on this project. We would also like to thank the volunteers for providing their time and effort into the creation of our dataset which has provide invaluable to our developmental efforts.

_{Copyright (C) 2023. This project was created using information collected from publicity available videos and volunteers and was created for educational reasons. Any parts of this project should ONLY be used for NON-COMMERICAL reasons. This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses.}