High-performance message striping over reliable transport protocols

Nader Mohamed, Jameela Al-Jaroodi, Hong Jiang, David Swanson

    Research output: Contribution to journalArticlepeer-review

    8 Citations (Scopus)

    Abstract

    This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.

    Original languageEnglish
    Pages (from-to)261-278
    Number of pages18
    JournalJournal of Supercomputing
    Volume38
    Issue number3
    DOIs
    Publication statusPublished - Dec 2006

    Keywords

    • Network services
    • Parallel data transfer and striping
    • Scalable network bandwidth
    • Socket

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Software
    • Information Systems
    • Hardware and Architecture

    Fingerprint

    Dive into the research topics of 'High-performance message striping over reliable transport protocols'. Together they form a unique fingerprint.

    Cite this