TY - JOUR
T1 - High-performance message striping over reliable transport protocols
AU - Mohamed, Nader
AU - Al-Jaroodi, Jameela
AU - Jiang, Hong
AU - Swanson, David
N1 - Funding Information:
Acknowledgment This project was partially supported by a National Science Foundation grant (EPS-0091900), a Nebraska University Foundation grant (26-0511-0019), and an Academic Priority Grant of the University of Nebraska-Lincoln. We would also like to thank the members of the secure distributed information (SDI) group and the research computing facility (RCF) at the University of Nebraska-Lincoln for their continuous help and support. We would also like to extend our gratitude to the anonymous referees for their constructive comments and suggestions.
PY - 2006/12
Y1 - 2006/12
N2 - This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.
AB - This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.
KW - Network services
KW - Parallel data transfer and striping
KW - Scalable network bandwidth
KW - Socket
UR - http://www.scopus.com/inward/record.url?scp=33749455676&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33749455676&partnerID=8YFLogxK
U2 - 10.1007/s11227-006-8443-6
DO - 10.1007/s11227-006-8443-6
M3 - Article
AN - SCOPUS:33749455676
SN - 0920-8542
VL - 38
SP - 261
EP - 278
JO - Journal of Supercomputing
JF - Journal of Supercomputing
IS - 3
ER -