A new vector representation of short texts for classification

Abstract EN

Short and sparse characteristics and synonyms and homonyms are main obstacles for short-text classification.

In recent years, research on short-text classification has focused on expanding short texts but has barely guaranteed the validity of expanded words.

This study proposes a new method to weaken these effects without external knowledge.

The proposed method analyses short texts by using the topic model based on Latent Dirichlet Allocation (LDA), represents each short text by using a vector space model and presents a new method to adjust the vector of short texts.

In the experiments, two open short-text data sets composed of google news and web search snippets are utilised to evaluate the classification performance and prove the effectiveness of our method.