An Integrated Deep Generative Model for Text Classification and Generation

Abstract EN

Text classification and generation are two important tasks in the field of natural language processing.

In this paper, we deal with both tasks via Variational Autoencoder, which is a powerful deep generative model.

The self-attention mechanism is introduced to the encoder.

The modified encoder extracts the global feature of the input text to produce the hidden code, and we train a neural network classifier based on the hidden code to perform the classification.

On the other hand, the label of the text is fed into the decoder explicitly to enhance the categorization information, which could help with text generation.

The experiments have shown that our model could achieve competitive classification results and the generated text is realistic.

Thus the proposed integrated deep generative model could be an alternative for both tasks.