A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data
Joint Authors
Jiang, Tonghai
Cheng, Li
Zhou, Xi
Zhu, Hui-Juan
Zhu, Zheng-Wei
Shi, Wei-Lei
Zhao, Fan
Ma, Bo
Source
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-12, 12 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-01-28
Country of Publication
Egypt
No. of Pages
12
Main Subjects
Abstract EN
In data integration, entity resolution is an important technique to improve data quality.
Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric.
For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques.
In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics.
In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood.
We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project.
We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision.
Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets.
American Psychological Association (APA)
Zhu, Hui-Juan& Zhu, Zheng-Wei& Jiang, Tonghai& Cheng, Li& Shi, Wei-Lei& Zhou, Xi…[et al.]. 2018. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data. Journal of Sensors،Vol. 2018, no. 2018, pp.1-12.
https://search.emarefa.net/detail/BIM-1200867
Modern Language Association (MLA)
Zhu, Hui-Juan…[et al.]. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data. Journal of Sensors No. 2018 (2018), pp.1-12.
https://search.emarefa.net/detail/BIM-1200867
American Medical Association (AMA)
Zhu, Hui-Juan& Zhu, Zheng-Wei& Jiang, Tonghai& Cheng, Li& Shi, Wei-Lei& Zhou, Xi…[et al.]. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data. Journal of Sensors. 2018. Vol. 2018, no. 2018, pp.1-12.
https://search.emarefa.net/detail/BIM-1200867
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1200867