How it works

1. Hold the pinch gesture to record.

2. Do the motion with your other hand.

3. Stop pinching to stop recording.

4. It then shows you the motion’s path and tracks whether you followed the path (by literally just checking whether your hand went close enough to each point).

5. You can now gamify anything that relies on hand motions without having to train a fancy recognition model or do lots of manual tuning.

6. Caveat: this is a 1-day prototype, so I haven’t implemented anything to check whether players actually did the motion with a dumbbell in hand = players will 1000000% cheat.