Parallelization of irregular out-of-core applications for distributed-memory systems

Peter Brezany, Alok Choudhary, Minh Dang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Large scale irregular applications involve data arrays and other data structures that are too large to fit in main memory and hence reside on disks; such applications are called out-of-core applications. This paper presents techniques for implementing this kind of applications. In particular we present a design for a runtime system to efficiently support parallel execution of irregular out-of-core codes on distributed-memory systems. Furthermore, we describe the appropriate program transformations required to reduce the I/O overheads for staging data as well as for communication while maintaining load balance. The proposed techniques can be used by a parallelizing compiler or by users writing programs in node + message passing style. We have done a preliminary implementation of the techniques presented here. We introduce experimental results from a template CFD code to demonstrate the efficacy of the presented techniques.

Original languageEnglish (US)
Title of host publicationHigh-Performance Computing and Networking - International Conference and Exhibition, Proceedings
EditorsBob Hertzberger, Peter Sloot, Bob Hertzberger, Peter Sloot, Bob Hertzberger, Peter Sloot, Bob Hertzberger, Peter Sloot
PublisherSpringer Verlag
Pages811-820
Number of pages10
ISBN (Print)3540628983, 3540628983, 3540628983, 3540628983, 9783540628989, 9783540628989, 9783540628989, 9783540628989
DOIs
StatePublished - Jan 1 1997
EventInternational Conference and Exhibition on High-Performance Computing and Networking, HPCN Europe 1997 - Vienna, Austria
Duration: Apr 28 1997Apr 30 1997

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1225
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherInternational Conference and Exhibition on High-Performance Computing and Networking, HPCN Europe 1997
CountryAustria
CityVienna
Period4/28/974/30/97

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Parallelization of irregular out-of-core applications for distributed-memory systems'. Together they form a unique fingerprint.

  • Cite this

    Brezany, P., Choudhary, A., & Dang, M. (1997). Parallelization of irregular out-of-core applications for distributed-memory systems. In B. Hertzberger, P. Sloot, B. Hertzberger, P. Sloot, B. Hertzberger, P. Sloot, B. Hertzberger, & P. Sloot (Eds.), High-Performance Computing and Networking - International Conference and Exhibition, Proceedings (pp. 811-820). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1225). Springer Verlag. https://doi.org/10.1007/bfb0031652