Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition
Joint Authors
Baik, Sung Wook
Ul Haq, Ijaz
Ullah, Amin
Muhammad, Khan
Lee, Mi Young
Source
Issue
Vol. 2019, Issue 2019 (31 Dec. 2019), pp.1-10, 10 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2019-05-05
Country of Publication
Egypt
No. of Pages
10
Main Subjects
Abstract EN
Personalized movie summarization is demand of the current era due to an exponential growth in movies production.
The employed methods for movies summarization fail to satisfy the user’s requirements due to the subjective nature of movies data.
Therefore, in this paper, we present a user-preference based movie summarization scheme.
First, we segmented movie into shots using a novel entropy-based shots segmentation mechanism.
Next, temporal saliency of shots is computed, resulting in highly salient shots in which character faces are detected.
The resultant shots are then forward propagated to our trained deep CNN model for facial expression recognition (FER) to analyze the emotional state of the characters.
The final summary is generated based on user-preferred emotional moments from the seven emotions, i.e., afraid, angry, disgust, happy, neutral, sad, and surprise.
The subjective evaluation over five Hollywood movies proves the effectiveness of our proposed scheme in terms of user satisfaction.
Furthermore, the objective evaluation verifies the superiority of the proposed scheme over state-of-the-art movie summarization methods.
American Psychological Association (APA)
Ul Haq, Ijaz& Ullah, Amin& Muhammad, Khan& Lee, Mi Young& Baik, Sung Wook. 2019. Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition. Complexity،Vol. 2019, no. 2019, pp.1-10.
https://search.emarefa.net/detail/BIM-1131457
Modern Language Association (MLA)
Ul Haq, Ijaz…[et al.]. Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition. Complexity No. 2019 (2019), pp.1-10.
https://search.emarefa.net/detail/BIM-1131457
American Medical Association (AMA)
Ul Haq, Ijaz& Ullah, Amin& Muhammad, Khan& Lee, Mi Young& Baik, Sung Wook. Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition. Complexity. 2019. Vol. 2019, no. 2019, pp.1-10.
https://search.emarefa.net/detail/BIM-1131457
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1131457