An Evaluation Model and Benchmark for Parallel Computing Frameworks
Joint Authors
Fan, Weibei
Zhijie, Han
Wang, Ru-chuan
Source
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-14, 14 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-03-29
Country of Publication
Egypt
No. of Pages
14
Main Subjects
Telecommunications Engineering
Abstract EN
MARS and Spark are two popular parallel computing frameworks and widely used for large-scale data analysis.
In this paper, we first propose a performance evaluation model based on support vector machine (SVM), which is used to analyze the performance of parallel computing frameworks.
Furthermore, we give representative results of a set of analysis with the proposed analytical performance model and then perform a comparative evaluation of MARS and Spark by using representative workloads and considering factors, such as performance and scalability.
The experiments show that our evaluation model has higher accuracy than multifactor line regression (MLR) in predicting execution time, and it also provides a resource consumption requirement.
Finally, we study benchmark experiments between MARS and Spark.
MARS has better performance than Spark in both throughput and speedup in the executions of logistic regression and Bayesian classification because MARS has a large number of GPU threads that can handle higher parallelism.
It also shows that Spark has lower latency than MARS in the execution of the four benchmarks.
American Psychological Association (APA)
Fan, Weibei& Zhijie, Han& Wang, Ru-chuan. 2018. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems،Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1204773
Modern Language Association (MLA)
Fan, Weibei…[et al.]. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems No. 2018 (2018), pp.1-14.
https://search.emarefa.net/detail/BIM-1204773
American Medical Association (AMA)
Fan, Weibei& Zhijie, Han& Wang, Ru-chuan. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems. 2018. Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1204773
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1204773