Development of a Hand Gestures SDK for NUI-Based Applications

Abstract EN

Concomitant with the advent of the ubiquitous era, research into better human computer interaction (HCI) for human-focused interfaces has intensified.

Natural user interface (NUI), in particular, is being actively investigated with the objective of more intuitive and simpler interaction between humans and computers.

However, developing NUI-based applications without special NUI-related knowledge is difficult.

This paper proposes a NUI-specific SDK, called “Gesture SDK,” for development of NUI-based applications.

Gesture SDK provides a gesture generator with which developers can directly define gestures.

Further, a “Gesture Recognition Component” is provided that enables defined gestures to be recognized by applications.

We generated gestures using the proposed SDK and developed a “Smart Interior,” NUI-based application using the Gesture Recognition Component.

The results of experiments conducted indicate that the recognition rate of the generated gestures was 96% on average.