Distributed and Parallel Big Textual Data Parsing for Social Sensor Network
Joint Authors
Jung, Hanmin
Um, Jung-Ho
Lee, Seungwoo
Choi, Sung-Pil
Kim, Hwan-Min
Jeong, Chang-Hoo
Source
International Journal of Distributed Sensor Networks
Issue
Vol. 2013, Issue - (31 Dec. 2013), pp.1-6, 6 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2013-12-09
Country of Publication
Egypt
No. of Pages
6
Main Subjects
Telecommunications Engineering
Information Technology and Computer Science
Abstract EN
Recently, due to the popularization of the smartphone and social network service (SNS), many SNS users write their opinions for social events.
According to these social phenomena, social sensor network which analyzes social events by utilizing those users’ text data is proposed.
Parsing is essential module to analyze user’s text contents because it gives the understanding of semantics by extracting the words and their classes from texts.
However, parsing requires much time because it needs to analyze all context information from the users’ text.
In addition, as users’ text data are generated and transferred in streaming, the required parsing time increases too.
This situation occurs that it is hard to parse the text on the single machine.
Therefore, to drastically enhance the parsing speed, we propose distributed and parallel parsing system on the MapReduce.
It applies the legacy parser to the MapReduce through loose coupling.
Also, to reduce communication overheads, the statistical model used by the parser is resided on local cache in each mapper.
The experimental result shows that the speed of proposed system is 2–19 times better than that of the legacy parser.
As a result, we prove that the proposed system is useful for parsing text data in social sensor network.
American Psychological Association (APA)
Um, Jung-Ho& Jeong, Chang-Hoo& Choi, Sung-Pil& Lee, Seungwoo& Kim, Hwan-Min& Jung, Hanmin. 2013. Distributed and Parallel Big Textual Data Parsing for Social Sensor Network. International Journal of Distributed Sensor Networks،Vol. 2013, no. -, pp.1-6.
https://search.emarefa.net/detail/BIM-478646
Modern Language Association (MLA)
Um, Jung-Ho…[et al.]. Distributed and Parallel Big Textual Data Parsing for Social Sensor Network. International Journal of Distributed Sensor Networks Vol. 2013, pp.1-6.
https://search.emarefa.net/detail/BIM-478646
American Medical Association (AMA)
Um, Jung-Ho& Jeong, Chang-Hoo& Choi, Sung-Pil& Lee, Seungwoo& Kim, Hwan-Min& Jung, Hanmin. Distributed and Parallel Big Textual Data Parsing for Social Sensor Network. International Journal of Distributed Sensor Networks. 2013. Vol. 2013, no. -, pp.1-6.
https://search.emarefa.net/detail/BIM-478646
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-478646