Your Knock Is My Command: Binary Hand Gesture Recognition on Smartphone with Accelerometer
Joint Authors
Bai, Liang
Zhang, Yonghui
Chen, Chunlei
Zhang, Huixiang
Xu, Wenteng
Source
Issue
Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-16, 16 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2020-07-26
Country of Publication
Egypt
No. of Pages
16
Main Subjects
Telecommunications Engineering
Abstract EN
Motion-based hand gesture is an important scheme to allow users to invoke commands on their smartphones in an eyes-free manner.
However, the existing scheme is facing some problems.
On the one hand, the expression ability of one single gesture is limited.
As a result, a gesture set consisting of multiple gestures is typically adopted to represent different commands.
Users must memorize all gestures in order to make interaction successfully.
On the other hand, the design of gestures needs to be complicated to express diverse intensions.
However, complex gestures are difficult to learn and remember.
In addition, complex gestures set a high recognition barrier to smart APPs.
This leads to an imbalance problem.
Different gestures have different recognition accuracy levels, which may result in instability of recognition precision in practical applications.
To address these problems, this paper proposes a novel scheme using binary motion gestures.
Only two simple gestures are required to express bit “0” and “1,” and rich information can be expressed through the permutation and combination of the two binary gestures.
Firstly, four kinds of candidate binary gestures are evaluated for eyes-free interactions.
Then, an online signal cutting and merging algorithm is designed to split accelerometer signals sequence into multiple separate gesture signal segments.
Next, five algorithms, including Dynamic Time Warping (DTW), Naive Bayes, Decision Tree, Support Vector Machine (SVM), and Bidirectional Long Short-Term Memory (BLSTM) Network, are adopted to recognize these segments of knock gestures.
The BLSTM achieves the top performance in terms of both recognition accuracy and recognition imbalance.
Finally, an Android application is developed to illustrate the usability of the proposed binary gestures.
As binary gestures are much simpler than traditional hand gestures, they are more efficient and user-friendly.
Our scheme eliminates the imbalance problem and achieves high recognition accuracy.
American Psychological Association (APA)
Zhang, Huixiang& Xu, Wenteng& Chen, Chunlei& Bai, Liang& Zhang, Yonghui. 2020. Your Knock Is My Command: Binary Hand Gesture Recognition on Smartphone with Accelerometer. Mobile Information Systems،Vol. 2020, no. 2020, pp.1-16.
https://search.emarefa.net/detail/BIM-1192552
Modern Language Association (MLA)
Zhang, Huixiang…[et al.]. Your Knock Is My Command: Binary Hand Gesture Recognition on Smartphone with Accelerometer. Mobile Information Systems No. 2020 (2020), pp.1-16.
https://search.emarefa.net/detail/BIM-1192552
American Medical Association (AMA)
Zhang, Huixiang& Xu, Wenteng& Chen, Chunlei& Bai, Liang& Zhang, Yonghui. Your Knock Is My Command: Binary Hand Gesture Recognition on Smartphone with Accelerometer. Mobile Information Systems. 2020. Vol. 2020, no. 2020, pp.1-16.
https://search.emarefa.net/detail/BIM-1192552
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1192552