A creative hardware-software interactive project that responds to physical taps using Force Sensitive Resistors (FSRs) to play dynamic videos on an LCD via a Raspberry Pi + Arduino combo.
π¬ Hit the bongos (FSRs), trigger a video. Designed for gamified learning, music interfaces, or AI gesture training pipelines.
- ποΈ Dual FSR sensor input (left and right taps)
- π½οΈ Fullscreen video playback (start, left, right)
- π Auto-reset to default looping video after action
- π Seamless serial communication between Arduino & Raspberry Pi
- π Real-time FSR tap data can be logged to Excel for later ML analysis
- π§ Model integration ready: Send tap metadata to any AI pipeline
- π₯οΈ 800x480 LCD screen output with GUI overlay
- π Supports relays to drive 12V LED light responses
| Component | Description |
|---|---|
| π Raspberry Pi 3 | With Raspbian OS |
| π§ Arduino Uno R3 | Reads the FSR inputs |
| π 800x480 LCD display | HDMI or GPIO based |
| β‘ 12V LED Strip Light | Triggered by relay switch |
| π²οΈ 2x FSR Sensors | Left and Right "Bongo" input |
| π Relay Module | To switch LED lights based on taps |
| πΌ Videos: | start.mp4, afterleft2.mp4, afterright2.mp4 |
- Python 3 (on Raspberry Pi)
- Tkinter (GUI)
- pyserial (Serial comm)
- VLC / cvlc (Video player)
- Arduino C (for sensor reading)
- psutil (optional for clean VLC process killing)
- pandas / openpyxl (optional, for FSR logging to Excel)
- Connect Arduino via USB
- sudo apt-get update
- sudo apt-get install vlc
- pip install pyserial
Place your videos (start.mp4, afterleft2.mp4, afterright2.mp4) in the same folder as the Python script.
- python3 bongos_code_windows.py
- Press ESC anytime to quit the program.
FSR Tap -> Arduino detects -> Sends "left"/"right"
-> Python reads Serial -> Switches video via VLC
-> FSR data stored (optional) β Sent to AI model
- Pull requests and forks are welcome! If youβd like to improve the GUI, logging system, or hardware interaction, feel free to submit ideas or PRs.
MIT License β feel free to modify, use, and share for personal and educational purposes.
- @aadhur - Aadhurshini
- @lolakshay - Akshay Srinivas N
π Engineering Students | π‘ AI Enthusiast