NUMA-Aware Thread Scheduling for Big Data Transfers over Terabits Network Infrastructure
Joint Authors
Kim, Youngjae
Kim, Taeuk
Khan, Awais
Kasu, Preethika
Atchley, Scott
Source
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-8, 8 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-05-07
Country of Publication
Egypt
No. of Pages
8
Main Subjects
Abstract EN
The evergrowing trend of big data has led scientists to share and transfer the simulation and analytical data across the geodistributed research and computing facilities.
However, the existing data transfer frameworks used for data sharing lack the capability to adopt the attributes of the underlying parallel file systems (PFS).
LADS (Layout-Aware Data Scheduling) is an end-to-end data transfer tool optimized for terabit network using a layout-aware data scheduling via PFS.
However, it does not consider the NUMA (Nonuniform Memory Access) architecture.
In this paper, we propose a NUMA-aware thread and resource scheduling for optimized data transfer in terabit network.
First, we propose distributed RMA buffers to reduce memory controller contention in CPU sockets and then schedule the threads based on CPU socket and NUMA nodes inside CPU socket to reduce memory access latency.
We design and implement the proposed resource and thread scheduling in the existing LADS framework.
Experimental results showed from 21.7% to 44% improvement with memory-level optimizations in the LADS framework as compared to the baseline without any optimization.
American Psychological Association (APA)
Kim, Taeuk& Khan, Awais& Kim, Youngjae& Kasu, Preethika& Atchley, Scott. 2018. NUMA-Aware Thread Scheduling for Big Data Transfers over Terabits Network Infrastructure. Scientific Programming،Vol. 2018, no. 2018, pp.1-8.
https://search.emarefa.net/detail/BIM-1214688
Modern Language Association (MLA)
Kim, Taeuk…[et al.]. NUMA-Aware Thread Scheduling for Big Data Transfers over Terabits Network Infrastructure. Scientific Programming No. 2018 (2018), pp.1-8.
https://search.emarefa.net/detail/BIM-1214688
American Medical Association (AMA)
Kim, Taeuk& Khan, Awais& Kim, Youngjae& Kasu, Preethika& Atchley, Scott. NUMA-Aware Thread Scheduling for Big Data Transfers over Terabits Network Infrastructure. Scientific Programming. 2018. Vol. 2018, no. 2018, pp.1-8.
https://search.emarefa.net/detail/BIM-1214688
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1214688