Skip to content

Instantly share code, notes, and snippets.

@TheJLifeX

TheJLifeX/01-README.md

Last active February 22, 2024 19:31
Show Gist options
  • Save TheJLifeX/99cdf4823e2b7867c0e94fabc660c58b to your computer and use it in GitHub Desktop.
Save TheJLifeX/99cdf4823e2b7867c0e94fabc660c58b to your computer and use it in GitHub Desktop.
Download ZIP
Simple Hand Mouvement Recognition Code - Hand tracking - Mediapipe
Raw
01-README.md

Simple Hand Mouvement Recognition Code - Hand tracking - Mediapipe

Goal of this gist is to recognize some simple hand mouvements like Scrolling, Zoom in/out and Slide left/right (see 08-hand-mouvement.gif below).

The whole code for that can be found here: hand-mouvement-recognition-calculator.cc.

You can clone my forked version of mediapipe here: https://github.com/TheJLifeX/mediapipe. I have already commited all code in that repository in the "hand-mouvement-recognition" branch (https://github.com/TheJLifeX/mediapipe/tree/hand-mouvement-recognition).

If you want to know how to recognize hand gesture like ONE, TWO, TREE, FOUR, FIVE, SIX, YEAH, ROCK, SPIDERMAN and OK. You can read this gist: Simple Hand Gesture Recognition.

Prerequisite: You kwon how to run the hand tracking example.

  1. Get Started with mediapipe
  2. Hand Tracking on Desktop
Raw
03-scrolling.md

Hand Mouvement: Scrolling

There are four defined scroll directions (up, right, down and left). To determine the scroll direction we have to calculate the angle between the current center of the hand closed (red) rectangle, the previous center and the x-axis.

  • Scroll up: angle between 135° and 45°
  • Scroll right: angle between 45° and -45°
  • Scroll down: angle between -45° and -135°
  • Scroll left: angle between -135° and 135°

Code for the hand mouvement "Scrolling" recogniton can be found here

Raw
05-zoom-in-out.md

Hand Mouvement: Zoom in/out

The idea here is that when the hand closed (red) rectangle becomes bigger that will be recognized as "Zoom in", and when smaller as "Zoom out". I used only the height of the hand closed rectangle but the width or the height and width can be used.

Code for the hand mouvement "Zoom in/out" recogniton can be found here

Raw
06-slide-left-right.md

Hand Mouvement: Slide left/right

The idea here is that to slide left or the right the hand must be first upright. For that we define a interavall for the angle between the hand (wirst and MCP) and the x-axis. For the start position this angle is between 80° and 100°. We define this rule for a simple reason. After a "Slide right" for example the hand mouvement to the left should not be as "Slide left" recognized.

Code for the hand mouvement "Slide left/right" recogniton can be found here

Raw
09-hand-mouvement-recognition.mp4
This file has been truncated, but you can view the full file.
View raw
@NandhaKishorM
Copy link

I0930 10:06:46.818581 5139 demo_run_graph_main.cc:53] Initialize the calculator graph.
E0930 10:06:46.820902 5139 demo_run_graph_main.cc:146] Failed to run the graph: ValidatedGraphConfig Initialization failed.
AnnotationOverlayCalculator: ; cc->Inputs().HasTag(recognizedHandMouvementScrollingTag)_overlay_calculator.cc:176)

@NandhaKishorM
Copy link

running script: GLOG_logtostderr=1 bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_cpu --calculator_graph_config_file=mediapipe/graphs/hand_tracking/hand_tracking_desktop_live.pbtxt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment