Skip to content

Arduino + Raspberry Pi FSR-based video response system for interactive learning and gesture recognition.

Notifications You must be signed in to change notification settings

alansahai/Autism-Bongos

Β 
Β 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

11 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ₯ Bongos Interactive FSR Response System

A creative hardware-software interactive project that responds to physical taps using Force Sensitive Resistors (FSRs) to play dynamic videos on an LCD via a Raspberry Pi + Arduino combo.

🎬 Hit the bongos (FSRs), trigger a video. Designed for gamified learning, music interfaces, or AI gesture training pipelines.


πŸš€ Features

  • πŸŽ›οΈ Dual FSR sensor input (left and right taps)
  • πŸ“½οΈ Fullscreen video playback (start, left, right)
  • πŸ” Auto-reset to default looping video after action
  • πŸ”Œ Seamless serial communication between Arduino & Raspberry Pi
  • πŸ“Š Real-time FSR tap data can be logged to Excel for later ML analysis
  • 🧠 Model integration ready: Send tap metadata to any AI pipeline
  • πŸ–₯️ 800x480 LCD screen output with GUI overlay
  • πŸ”‚ Supports relays to drive 12V LED light responses

🧰 Hardware Requirements

Component Description
πŸ”Œ Raspberry Pi 3 With Raspbian OS
🧠 Arduino Uno R3 Reads the FSR inputs
πŸ“Ÿ 800x480 LCD display HDMI or GPIO based
⚑ 12V LED Strip Light Triggered by relay switch
πŸ–²οΈ 2x FSR Sensors Left and Right "Bongo" input
πŸ” Relay Module To switch LED lights based on taps
πŸ“Ό Videos: start.mp4, afterleft2.mp4, afterright2.mp4

πŸ’» Software Stack

  • Python 3 (on Raspberry Pi)
  • Tkinter (GUI)
  • pyserial (Serial comm)
  • VLC / cvlc (Video player)
  • Arduino C (for sensor reading)
  • psutil (optional for clean VLC process killing)
  • pandas / openpyxl (optional, for FSR logging to Excel)

βš™οΈ Setup Instructions

Raspberry Pi

  • Connect Arduino via USB

Install required Python packages:

- sudo apt-get update
- sudo apt-get install vlc
- pip install pyserial

Place your videos (start.mp4, afterleft2.mp4, afterright2.mp4) in the same folder as the Python script.

Run the script:

- python3 bongos_code_windows.py
- Press ESC anytime to quit the program.

Work flow demo:

FSR Tap -> Arduino detects -> Sends "left"/"right"
    -> Python reads Serial -> Switches video via VLC
    -> FSR data stored (optional) β†’ Sent to AI model

πŸ™Œ Contributing

  • Pull requests and forks are welcome! If you’d like to improve the GUI, logging system, or hardware interaction, feel free to submit ideas or PRs.

πŸ“œ License

MIT License – feel free to modify, use, and share for personal and educational purposes.

πŸ‘€ Authors

πŸŽ“ Engineering Students | πŸ’‘ AI Enthusiast

About

Arduino + Raspberry Pi FSR-based video response system for interactive learning and gesture recognition.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 82.6%
  • C++ 17.4%