High-Performance I/O for Massively Parallel Computers Problems and Prospects

Juan Miguel del Rosario, Alok N. Choudhary

Research output: Contribution to specialist publicationArticle

91 Scopus citations

Abstract

Over the past two decades (1974-94), advances in semiconductor and integrated circuit technology have fuelled the drive toward faster, ever more efficient computational machines. Today, the most powerful supercomputers can perform computation at billions of floating-point operations per second (gigaflops). This increase in capability is intensifying the demand for even more powerful machines. Computational limits for the largest supercomputers are expected to exceed the teraflops barrier in the coming years. Discussion is given on the following areas: the nature of I/O in massive parallel processing; operating and file systems; runtime system and compilers; and networking technology. The recurrent themes in the parallel I/O problem are the existence of a great variety in access patterns and the sensitivity of current I/O systems to these access patterns. An increase in the variability of access patterns is also expected, and single resource-management approaches will likely not suffice. Providing the I/O infrastructure that will support these requirements will necessitate research in operating systems (parallel file systems, runtime systems, and drivers), language interfaces to high-performance storage systems, high-speed networking, graphics and visualization systems, and new hardware technology for I/O and storage systems.

Original languageEnglish (US)
Pages59-68
Number of pages10
Volume27
No3
Specialist publicationComputer
DOIs
StatePublished - Mar 1994

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'High-Performance I/O for Massively Parallel Computers Problems and Prospects'. Together they form a unique fingerprint.

Cite this