![](/images/graphics-bg.png)
n-Gram-Based Text Compression
Joint Authors
Snášel, Václav
Nguyen, Vu H.
Nguyen, Hien T.
Duong, Hieu N.
Source
Computational Intelligence and Neuroscience
Issue
Vol. 2016, Issue 2016 (31 Dec. 2015), pp.1-11, 11 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2016-11-14
Country of Publication
Egypt
No. of Pages
11
Main Subjects
Abstract EN
We propose an efficient method for compressing Vietnamese text using n-gram dictionaries.
It has a significant compression ratio in comparison with those of state-of-the-art methods on the same dataset.
Given a text, first, the proposed method splits it into n-grams and then encodes them based on n-gram dictionaries.
In the encoding phase, we use a sliding window with a size that ranges from bigram to five grams to obtain the best encoding stream.
Each n-gram is encoded by two to four bytes accordingly based on its corresponding n-gram dictionary.
We collected 2.5 GB text corpus from some Vietnamese news agencies to build n-gram dictionaries from unigram to five grams and achieve dictionaries with a size of 12 GB in total.
In order to evaluate our method, we collected a testing set of 10 different text files with different sizes.
The experimental results indicate that our method achieves compression ratio around 90% and outperforms state-of-the-art methods.
American Psychological Association (APA)
Nguyen, Vu H.& Nguyen, Hien T.& Duong, Hieu N.& Snášel, Václav. 2016. n-Gram-Based Text Compression. Computational Intelligence and Neuroscience،Vol. 2016, no. 2016, pp.1-11.
https://search.emarefa.net/detail/BIM-1099822
Modern Language Association (MLA)
Nguyen, Vu H.…[et al.]. n-Gram-Based Text Compression. Computational Intelligence and Neuroscience Vol. 2016, no. 2016 (2015), pp.1-11.
https://search.emarefa.net/detail/BIM-1099822
American Medical Association (AMA)
Nguyen, Vu H.& Nguyen, Hien T.& Duong, Hieu N.& Snášel, Václav. n-Gram-Based Text Compression. Computational Intelligence and Neuroscience. 2016. Vol. 2016, no. 2016, pp.1-11.
https://search.emarefa.net/detail/BIM-1099822
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1099822