An Evaluation Model and Benchmark for Parallel Computing Frameworks

Joint Authors

Fan, Weibei
Zhijie, Han
Wang, Ru-chuan

Source

Mobile Information Systems

Issue

Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-14, 14 p.

Publisher

Hindawi Publishing Corporation

Publication Date

2018-03-29

Country of Publication

Egypt

No. of Pages

14

Main Subjects

Telecommunications Engineering

Abstract EN

MARS and Spark are two popular parallel computing frameworks and widely used for large-scale data analysis.

In this paper, we first propose a performance evaluation model based on support vector machine (SVM), which is used to analyze the performance of parallel computing frameworks.

Furthermore, we give representative results of a set of analysis with the proposed analytical performance model and then perform a comparative evaluation of MARS and Spark by using representative workloads and considering factors, such as performance and scalability.

The experiments show that our evaluation model has higher accuracy than multifactor line regression (MLR) in predicting execution time, and it also provides a resource consumption requirement.

Finally, we study benchmark experiments between MARS and Spark.

MARS has better performance than Spark in both throughput and speedup in the executions of logistic regression and Bayesian classification because MARS has a large number of GPU threads that can handle higher parallelism.

It also shows that Spark has lower latency than MARS in the execution of the four benchmarks.

American Psychological Association (APA)

Fan, Weibei& Zhijie, Han& Wang, Ru-chuan. 2018. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems،Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1204773

Modern Language Association (MLA)

Fan, Weibei…[et al.]. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems No. 2018 (2018), pp.1-14.
https://search.emarefa.net/detail/BIM-1204773

American Medical Association (AMA)

Fan, Weibei& Zhijie, Han& Wang, Ru-chuan. An Evaluation Model and Benchmark for Parallel Computing Frameworks. Mobile Information Systems. 2018. Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1204773

Data Type

Journal Articles

Language

English

Notes

Includes bibliographical references

Record ID

BIM-1204773