A real-time Sign Language Detection application using LSTM and MediaPipe. This project captures motion data from hand gestures and translates them into text/sign labels.
- app.py: Main application entry point.
- collectdata.py: Script to collect data for training new signs.
- trainmodel.py: Script to train the LSTM model.
- function.py: Helper functions for MediaPipe detection.
- MP_Data/: Pre-processed numpy arrays used for training/inference.
- Models/: Contains trained model weights (
model.h5, etc.). - docs/: Project documentation (Reports, Research Paper, etc.).
The raw video dataset for this project is available on Kaggle: Link to Kaggle Dataset
-
Install Dependencies Ensure you have the required Python packages (TensorFlow, OpenCV, MediaPipe, etc.).
pip install tensorflow opencv-python mediapipe numpy matplotlib
-
Run the Application
python app.py
If you want to retrain the model on new data:
- Run
collectdata.pyto capture new sequences. - Run
trainmodel.pyto train the LSTM model.