Optimization and evaluation of hartree-fock application's I/O with PASSION

Meenakshi A. Kandaswamy, Mahmut T. Kandemir, Alok N. Choudhary, David E. Bernholdt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Parallel machines are an important part of the scientific application developer's tool box and the processing demands placed on these machines are rapidly increasing. Many scientific applications tend to perform high volume data storage, data retrieval and data processing, which demands high performance from the I/O subsystem. In this paper, we conduct an experimental study of the I/O performed by the Hartree-Fock (HF) method, as implemented using a fully distributed data approach in the NWChem parallel computational chemistry package. We use PASSION, a parallel and scalable I/O library to improve the I/O performance of the application and present extensive experimental results. The effects of both application-related factors and system-related factors on the application's I/O performance are studied in detail. We rank the optimizations based on the significance and impact on the performance of HF's I/O phase as: I. efficient interface to the file system, II. prefetching, and III. buffering. The results show that within the limits of our experimental framework, application-related factors are more effective on the overall I/O behavior of this application. We obtained up to 95% improvement in I/O time and 43% improvement in the overall application performance with the optimizations.

Original languageEnglish (US)
Title of host publicationProceedings of the 1997 ACM/IEEE Conference on Supercomputing, SC 1997
PublisherAssociation for Computing Machinery
ISBN (Print)0897919858, 9780897919852
DOIs
StatePublished - 1997
Event1997 ACM/IEEE Conference on Supercomputing, SC 1997 - San Jose, CA, United States
Duration: Nov 15 1997Nov 21 1997

Publication series

NameProceedings of the International Conference on Supercomputing

Other

Other1997 ACM/IEEE Conference on Supercomputing, SC 1997
CountryUnited States
CitySan Jose, CA
Period11/15/9711/21/97

Keywords

  • Computational chemistry
  • File system interface
  • High-performance I/O
  • Parallel application
  • Prefetching
  • Run-time system

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Optimization and evaluation of hartree-fock application's I/O with PASSION'. Together they form a unique fingerprint.

Cite this