![](/images/graphics-bg.png)
A Replication-Based Mechanism for Fault Tolerance in MapReduce Framework
Joint Authors
Source
Mathematical Problems in Engineering
Issue
Vol. 2015, Issue 2015 (31 Dec. 2015), pp.1-7, 7 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2015-09-16
Country of Publication
Egypt
No. of Pages
7
Main Subjects
Abstract EN
MapReduce is a programming model and an associated implementation for processing and generating large data sets with a parallel, distributed algorithm on a cluster.
In cloud environment, node and task failure are no longer accidental but a common feature of large-scale systems.
Current rescheduling-based fault tolerance method in MapReduce framework failed to fully consider the location of distributed data and the computation and storage overhead of rescheduling failure tasks.
Thus, a single node failure will increase the completion time dramatically.
In this paper, a replication-based mechanism is proposed, which takes both task and node failure into consideration.
Experimental results show that, compared with default mechanism in Hadoop, our mechanism can significantly improve the performance at failure time, with more than 30% decreasing in execution time.
American Psychological Association (APA)
Liu, Yang& Wei, Wei. 2015. A Replication-Based Mechanism for Fault Tolerance in MapReduce Framework. Mathematical Problems in Engineering،Vol. 2015, no. 2015, pp.1-7.
https://search.emarefa.net/detail/BIM-1073763
Modern Language Association (MLA)
Liu, Yang& Wei, Wei. A Replication-Based Mechanism for Fault Tolerance in MapReduce Framework. Mathematical Problems in Engineering No. 2015 (2015), pp.1-7.
https://search.emarefa.net/detail/BIM-1073763
American Medical Association (AMA)
Liu, Yang& Wei, Wei. A Replication-Based Mechanism for Fault Tolerance in MapReduce Framework. Mathematical Problems in Engineering. 2015. Vol. 2015, no. 2015, pp.1-7.
https://search.emarefa.net/detail/BIM-1073763
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1073763