This project provides a real-time hand gesture recognition system using MediaPipe and deep learning classifiers. It includes a Python application for recognizing hand gestures from webcam input, as well as tools for training and evaluating keypoint and point history classifiers.
- Real-time hand gesture recognition using webcam
- Keypoint and point history classification
- Pre-trained models included
- Modular code structure for easy extension
main.py
hand-gesture-recognition-mediapipe/
app.py
keypoint_classification_EN.ipynb
keypoint_classification.ipynb
point_history_classification.ipynb
model/
keypoint_classifier/
point_history_classifier/
utils/
main.py: Entry point for the project.hand-gesture-recognition-mediapipe/app.py: Main application for gesture recognition.model/: Contains pre-trained models and related scripts.utils/: Utility functions (e.g., FPS calculation).- Jupyter Notebooks: For training and experimenting with classifiers.
- Python 3.10+
- MediaPipe
- OpenCV
- NumPy
- TensorFlow
Install dependencies with:
pip install -r requirements.txtIf
requirements.txtis missing, install manually:pip install mediapipe opencv-python numpy tensorflow
To run the hand gesture recognition app:
python hand-gesture-recognition-mediapipe/app.pyUse the provided Jupyter notebooks to train or fine-tune classifiers:
keypoint_classification_EN.ipynbkeypoint_classification.ipynbpoint_history_classification.ipynb
Pre-trained models are stored in:
model/keypoint_classifier/model/point_history_classifier/
See hand-gesture-recognition-mediapipe/LICENSE.
- MediaPipe
- Original gesture recognition codebase inspiration
Feel free to contribute or open issues!
