Mobile-based human emotion recognition based on speech and heart rate
Other Title(s)
تمييز المشاعر الإنسانية باستخدام الهاتف الذكي عبر الأنترنيت
Joint Authors
Sawadi, Huda Majid
Ali, Hamid Muhammad
Source
Issue
Vol. 25, Issue 11 (30 Nov. 2019), pp.55-66, 12 p.
Publisher
University of Baghdad College of Engineering
Publication Date
2019-11-30
Country of Publication
Iraq
No. of Pages
12
Main Subjects
Information Technology and Computer Science
Abstract EN
Mobile-based human emotion recognition is a very challenging subject, most of the approaches suggested and built in this field utilized various contexts that can be derived from the external sensors and the smartphone, but these approaches suffer from different obstacles and challenges.
The proposed system integrated human speech signal and heart rate, in one system, to leverage the accuracy of the human emotion recognition.
The proposed system is designed to recognize four human emotions; angry, happy, sad, and normal.
In this system, the smartphone is used to record user speech and send it to a server.
The smartwatch, fixed on user's wrist, is used to measure user heart rate while the user is speaking and send it, via Bluetooth, to the smartphone, which in turn sends it to the server.
At the server side, the speech features are extracted from the speech signal to be classified by a neural network.
To minimize the misclassification of the neural network, the user heart rate measurement is used to direct the extracted speech features to either excited (angry and happy) neural network or to the calm (sad and normal) neural network.
In spite of the challenges associated with the system, the system achieved 96.49% for known speakers and 79.05% for unknown speakers
American Psychological Association (APA)
Sawadi, Huda Majid& Ali, Hamid Muhammad. 2019. Mobile-based human emotion recognition based on speech and heart rate. Journal of Engineering،Vol. 25, no. 11, pp.55-66.
https://search.emarefa.net/detail/BIM-910376
Modern Language Association (MLA)
Sawadi, Huda Majid& Ali, Hamid Muhammad. Mobile-based human emotion recognition based on speech and heart rate. Journal of Engineering Vol. 25, no. 11 (Nov. 2019), pp.55-66.
https://search.emarefa.net/detail/BIM-910376
American Medical Association (AMA)
Sawadi, Huda Majid& Ali, Hamid Muhammad. Mobile-based human emotion recognition based on speech and heart rate. Journal of Engineering. 2019. Vol. 25, no. 11, pp.55-66.
https://search.emarefa.net/detail/BIM-910376
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references : p. 64-66
Record ID
BIM-910376