Fuzzy Emotional Semantic Analysis and Automated Annotation of Scene Images

Abstract EN

With the advances in electronic and imaging techniques, the production of digital images has rapidly increased, and the extraction and automated annotation of emotional semantics implied by images have become issues that must be urgently addressed.

To better simulate human subjectivity and ambiguity for understanding scene images, the current study proposes an emotional semantic annotation method for scene images based on fuzzy set theory.

A fuzzy membership degree was calculated to describe the emotional degree of a scene image and was implemented using the Adaboost algorithm and a back-propagation (BP) neural network.

The automated annotation method was trained and tested using scene images from the SUN Database.

The annotation results were then compared with those based on artificial annotation.

Our method showed an annotation accuracy rate of 91.2% for basic emotional values and 82.4% after extended emotional values were added, which correspond to increases of 5.5% and 8.9%, respectively, compared with the results from using a single BP neural network algorithm.

Furthermore, the retrieval accuracy rate based on our method reached approximately 89%.

This study attempts to lay a solid foundation for the automated emotional semantic annotation of more types of images and therefore is of practical significance.