COMPASSION: A parallel I/O runtime system including chunking and compression for irregular applications

Jesús Carretero, Jaechun No, Alok Choudhary, Pang Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

In this paper we present an experimental evaluation of COMPASSION, a runtime system for irregular applications based on collective I/O techniques. It provides a "Collective I/O" model, enhanced with " Pipelined" operations and compression. All processors participate in the I/O simultaneously, alone or grouped, making scheduling of I/O requests simpler and providing support for contention management. In-memory compression mechanisms reduce the total execution time by diminishing the amount of I/O requested and the I/O contention. Our experiments, executed on an Intel Paragon and on the ASCI/Red teraflops machine, demonstrate that COMPASSION can obtain significantly high-performance for I/O above what has been possible so far.

Original languageEnglish (US)
Title of host publicationSolving Irregularly Structured Problems in Parallel - 5th International Symposium, IRREGULAR 1998, Proceedings
Pages262-273
Number of pages12
StatePublished - Dec 1 1998
Event5th International Symposium on Solving Irregularly Structured Problems in Parallel, IRREGULAR 1998 - Berkeley, CA, United States
Duration: Aug 9 1998Aug 11 1998

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1457 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other5th International Symposium on Solving Irregularly Structured Problems in Parallel, IRREGULAR 1998
CountryUnited States
CityBerkeley, CA
Period8/9/988/11/98

Keywords

  • Compression
  • Irregular applications
  • Parallel I/O
  • Runtime systems

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'COMPASSION: A parallel I/O runtime system including chunking and compression for irregular applications'. Together they form a unique fingerprint.

  • Cite this

    Carretero, J., No, J., Choudhary, A., & Chen, P. (1998). COMPASSION: A parallel I/O runtime system including chunking and compression for irregular applications. In Solving Irregularly Structured Problems in Parallel - 5th International Symposium, IRREGULAR 1998, Proceedings (pp. 262-273). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1457 LNCS).