Automated tracing of I/O stack

Seong Jo Kim, Yuanrui Zhang, Seung Woo Son, Ramya Prabhakar, Mahmut Kandemir, Christina Patrick, Wei-Keng Liao, Alok Nidhi Choudhary

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Efficient execution of parallel scientific applications requires high-performance storage systems designed to meet their I/O requirements. Most high-performance I/O intensive applications access multiple layers of the storage stack during their disk operations. A typical I/O request from these applications may include accesses to high-level libraries such as MPI I/O, executing on clustered parallel file systems like PVFS2, which are in turn supported by native file systems like Linux. In order to design and implement parallel applications that exercise this I/O stack, it is important to understand the flow of I/O calls through the entire storage system. Such understanding helps in identifying the potential performance and power bottlenecks in different layers of the storage hierarchy. To trace the execution of the I/O calls and to understand the complex interactions of multiple user-libraries and file systems, we propose an automatic code instrumentation technique, which enables us to collect detailed statistics of the I/O stack. Our proposed I/O tracing tool traces the flow of I/O calls across different layers of an I/O stack, and can be configured to work with different file systems and user-libraries. It also analyzes the collected information to generate output in terms of different user-specified metrics of interest.

Original languageEnglish (US)
Title of host publicationRecent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings
Pages72-81
Number of pages10
DOIs
StatePublished - Nov 12 2010
Event17th European MPI Users' Group Meeting, EuroMPI 2010 - Stuttgart, Germany
Duration: Sep 12 2010Sep 15 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6305 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other17th European MPI Users' Group Meeting, EuroMPI 2010
CountryGermany
CityStuttgart
Period9/12/109/15/10

Keywords

  • Automated code instrumentation
  • MPI-IO
  • MPICH2
  • PVFS2
  • Parallel I/O

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Automated tracing of I/O stack'. Together they form a unique fingerprint.

  • Cite this

    Kim, S. J., Zhang, Y., Son, S. W., Prabhakar, R., Kandemir, M., Patrick, C., Liao, W-K., & Choudhary, A. N. (2010). Automated tracing of I/O stack. In Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings (pp. 72-81). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6305 LNCS). https://doi.org/10.1007/978-3-642-15646-5_8