A Self-Adaptive Hidden Markov Model for Emotion Classification in Chinese Microblogs

Abstract EN

Microblogging is increasingly becoming one of the most popular online social media for people to express ideas and emotions.

The amount of socially generated content from this medium is enormous.

Text mining techniques have been intensively applied to discover the hidden knowledge and emotions from this huge dataset.

In this paper,we propose a modified version of hidden Markov model (HMM) classifier, called self-adaptive HMM, whose parameters are optimized by Particle Swarm Optimization algorithms.

Since manually labeling large-scale dataset is difficult, we also employ the entropy to decide whether a new unlabeled tweet shall be contained in the training dataset after being assigned an emotion using our HMM-based approach.

In the experiment, we collected about 200,000 Chinese tweets from Sina Weibo.

The results show that the F-score of our approach gets 76% on happiness and fear and 65% on anger, surprise, and sadness.

In addition, the self-adaptive HMM classifier outperforms Naive Bayes and Support Vector Machine on recognition of happiness, anger, and sadness.