Efficient wire formats for high performance computing

Fabian Bustamante, Greg Eisenhauer, Karsten Schwan, Patrick Widener

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Scopus citations

Abstract

High performance computing is being increasingly utilized in non-traditional circumstances where it must interoperate with other applications. For example, online visualization is being used to monitor the progress of applications, and real-world sensors are used as inputs to simulations. Whenever these situations arise, there is a question of what communications infrastructure should be used to link the different components. Traditional HPC-style communications systems such as MPI offer relatively high performance, but are poorly suited for developing these less tightly-coupled cooperating applications. Object-based systems and meta-data formats like XML offer substantial plug-and-play flexibility, but with substantially lower performance. We observe that the flexibility and baseline performance of all these systems is strongly determined by their 'wire format', or how they represent data for transmission in a heterogeneous environment. We examine the performance implications of different wire formats and present an alternative with significant advantages in terms of both performance and flexibility.

Original languageEnglish (US)
Title of host publicationSC 2000 - Proceedings of the 2000 ACM/IEEE Conference on Supercomputing
PublisherAssociation for Computing Machinery
ISBN (Electronic)0780398025
DOIs
StatePublished - 2000
Externally publishedYes
Event2000 ACM/IEEE Conference on Supercomputing, SC 2000 - Dallas, United States
Duration: Nov 4 2000Nov 10 2000

Publication series

NameProceedings of the International Conference on Supercomputing
Volume2000-November

Conference

Conference2000 ACM/IEEE Conference on Supercomputing, SC 2000
Country/TerritoryUnited States
CityDallas
Period11/4/0011/10/00

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Efficient wire formats for high performance computing'. Together they form a unique fingerprint.

Cite this