HandSign-Drone

Based on certain hand signs, the drone will react accordingly. The hand signs are detected by a video stream that a Tello EDU Drone sends to the NVIDIA Jetson.

This program is capable of the following actions:

• Rotate counter-clockwise (Arm Extended)

• Rotate clockwise (Arm Angled Up)

• Do a flip (Pat on head)

• Land (Arm Angled Down)

Prerequisites

• Tello EDU Drone
• NVIDIA Jetson
• Python 3.6
• USB Wi-Fi Adapter
• NVIDIA Jetson Inference Project
  • Follow the instructions under the "Quick Reference" section by running all the commands in the code block one by one in the Jetson's terminal.
• H264Decoder
  • Follow the instructions listed under the Linux section of the README.md file.
  • You will likely need to run sudo apt-get install python3-setuptools before you can run pip install ..
• Tello AsyncIO
  • Run pip3 install tello-asyncio to install this package.
  • Once installed, replace all contents of the /home/{user}/.local/lib/python3.6/site-packages/tello_asyncio (where {user} is your username) with the contents of the python_packages/tello_asyncio folder in this repository.
• Tello AsyncIO Video
  • Clone the repository and run pip install . to install package.
  • Once installed, replace all contents of the /home/{user}/.local/lib/python3.6/site-packages/tello_asyncio_video (where {user} is your username) with the contents of the python_packages/tello_asyncio_video folder in this repository.
• Jetson Tello
  • You may need to run pip install numpy before you install this package.
  • Clone the repository and run pip install . to install package.
  • Once installed, replace all contents of the /home/{user}/.local/lib/python3.6/site-packages/jetson_tello (where {user} is your username) with the contents of the python_packages/jetson_tello folder in this repository.

Running the Program

1. Plug in the USB Wi-Fi adapter into the Jetson.
2. Connect the Jetson to the Tello's Wi-Fi network.
   • This can be done by running sudo nmcli dev wifi connect TELLO-XXXXXX in the terminal, where TELLO-XXXXXX is the name of the Tello's Wi-Fi network name. Run sudo nmcli dev wifi to see the list of available Wi-Fi networks and find the one that corresponds to your drone.
3. Run python3 handSignDetection.py in the terminal and watch your drone take off and perform actions based on your hand signs!

Troubleshooting

The only issue we noticed is that the drone may auto-land if it is not receiving any commands for a certain amount of time. If this happens, simply run python3 handSignDetection.py again and the drone will take off and continue to perform actions based on your hand signs.