The gesture recognition extension is based on webcam usage in order to track marker movements placed on the user's head or other part of his body. Talking about marker we mean any solid color object that is visible in the frame. For example:

  • a colored element (like a sticker, or a piece of tape) placed on the head, or glasses
  • glasses with a colored frame
  • a cap with a colored element
  • intense makeup
  • in some cases - mouth, or whole face


Marker deflection in four directions allows user to navigate and select a key on the virtual keyboard, or emulate the mouse pointer. Head movement example is shown on video material below.