AHPIOS: An MPI-based ad-hoc parallel I/O system

Florin Isailǎ; Javier Garcia Blas; Jesus Carretero; Wei Keng Liao; Alok Choudhary

doi:10.1109/ICPADS.2008.50

AHPIOS: An MPI-based ad-hoc parallel I/O system

Florin Isailǎ^*, Javier Garcia Blas, Jesus Carretero, Wei Keng Liao, Alok Choudhary

^*Corresponding author for this work

Electrical and Computer Engineering

Research output: Contribution to journal › Conference article › peer-review

6 Scopus citations

Abstract

This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPIIO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.

Original language	English (US)
Article number	4724327
Pages (from-to)	253-260
Number of pages	8
Journal	Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS
DOIs	https://doi.org/10.1109/ICPADS.2008.50
State	Published - 2008
Event	2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS'08 - Melbourne, VIC, Australia Duration: Dec 8 2008 → Dec 10 2008

ASJC Scopus subject areas

Hardware and Architecture

Access to Document

10.1109/ICPADS.2008.50

Cite this

@article{e89b1ef5ab1e41ef97146f282382c545,

title = "AHPIOS: An MPI-based ad-hoc parallel I/O system",

abstract = "This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPIIO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.",

author = "Florin Isailǎ and Blas, {Javier Garcia} and Jesus Carretero and Liao, {Wei Keng} and Alok Choudhary",

year = "2008",

doi = "10.1109/ICPADS.2008.50",

language = "English (US)",

pages = "253--260",

journal = "Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS",

issn = "1521-9097",

note = "2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS'08 ; Conference date: 08-12-2008 Through 10-12-2008",

}

TY - JOUR

T1 - AHPIOS

T2 - 2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS'08

AU - Isailǎ, Florin

AU - Blas, Javier Garcia

AU - Carretero, Jesus

AU - Liao, Wei Keng

AU - Choudhary, Alok

PY - 2008

Y1 - 2008

N2 - This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPIIO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.

AB - This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPIIO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.

UR - http://www.scopus.com/inward/record.url?scp=60649108451&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=60649108451&partnerID=8YFLogxK

U2 - 10.1109/ICPADS.2008.50

DO - 10.1109/ICPADS.2008.50

M3 - Conference article

AN - SCOPUS:60649108451

SN - 1521-9097

SP - 253

EP - 260

JO - Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

JF - Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

M1 - 4724327

Y2 - 8 December 2008 through 10 December 2008

ER -

AHPIOS: An MPI-based ad-hoc parallel I/O system

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this