MARVEL
Solo Project
Physical Computing and Programming
Adobe XD
OnShape
Blender
C/C++
Arduino
What is Marvel?
Marvel is a 3D printed hand model which uses computer vision and live hand tracking to play games like Rock-Paper-Scissors with humans. Fitted with 10 individual movable joints, Marvel can be programmed to do anything related to hand gestures.
Computer Vision
This was the core of the project. Live hand tracking was essential to ensure a handsfree gameplay experience. Programmed in python, I used a hand and finger tracker to track 21 points on a hand. Using data from these points, the hand can be programmed to interact, respond, or even copy human finger movements. All in real time.
Arduino Coding
Servo motors serve as joints for the hand and are controlled using a 16 channel drive attached to an Arduino microprocessor. The code controls the gameplay, the movement of the hand and fetches data from the Python program running the live hand tracking. It then computes all this data to keep score.