Human Computer Interaction Game by using OpenCV and Processing: Control the game character's velocity through the speed and direction of your fist or palm(hand)! Fist&palm(hand) is detected using Haar-Cascade Classifier is implemented with OpenCV on java. The trained Haar-Cascade Classifier XML files can be accessible in here. Please contact if you need professional human-computer inteaction based projects with the super high accuracy.

• The Game Scenario: The game character's (Super Mario's) velocity depends on the speed and direction someone's fist or palm(hand) (as user's choise) movements by using the computer's front-facing web camera. The 'stage' is just a 2D platform, with random holes on the ground and random clouds on sky. There is a timer upon game start, and that timer stops when the character collide to one of those holes or clouds (game end). A button resets the game stage.

• The Main Aim of The Game: The main aim of this proof-of concept game is that incentivizing the users to move/sport for keeping them healthy while they are having fun by playing a human - computer interaction game.

  • Games for human health, wellbeing, and fitness: I have recently begun to focus on making sports, physiological exercise, health, and wellbeing applications more playful, especially in light of the recent increase in sensor use and the quantified self movement.

1. Front-End

The 'stage' is just a 2D platform, with random holes on the ground and random clouds on sky and it was created by using Processing 3.0 with the images that are available in data folder.

2. Back-End

Haar-Cascade Classifier was used for fist and palm(hand) detection. The trained Haar-Cascade Classifier XML files are available in here.

A human–machine interface usually involves peripheral hardware for the INPUT and for the OUTPUT. Often, there is an additional component implemented in software, like e.g. a graphical user interface.

• The demo video of this project is available on YouTube: https://www.youtube.com/watch?v=HpzLbTf2OQk

Dependencies:

It is developed with "Processing 3.0" and it requires these library;

1. Video | GStreamer-based video library for Processing

2. OpenCV for Processing | Computer Vision with OpenCV for Processing

These libraries can be added on Processing 3.0 IDE --- follow this path: "Tools-> Add Tool->Libraries"

How to build and run this source?

1. Clone repository to your local and import project into Processing 3.0 IDE

2. Install the dependencies which are given at above

3. Build and run the project

If you use this code for your publications, please cite it as:

@ONLINE{vdtc,
    author = "Ahmet Özlü",
    title  = "Intelligent Human Computer Interaction Game",
    year   = "2017",
    url    = "https://github.com/ahmetozlu/human_computer_interaction"
}

Ahmet Özlü

This system is available under the MIT license. See the LICENSE file for more info.