Data partitioning and load balancing in parallel disk systems

Peter Scheuermann*, Gerhard Weikum, Peter Zabback

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

139 Scopus citations

Abstract

Parallel disk systems provide opportunities for exploiting I/O parallelism in two possible ways, namely via inter-request and intra-request parallelism. In this paper, we discuss the main issues in performance tuning of such systems, namely striping and load balancing, and show their relationship to response time and throughput. We outline the main components of an intelligent, self-reliant file system that aims to optimize striping by taking into account the requirements of the applications, and performs load balancing by judicious file allocation and dynamic redistributions of the data when access patterns change. Our system uses simple but effective heuristics that incur only little overhead. We present performance experiments based on synthetic workloads and real-life traces.

Original languageEnglish (US)
Pages (from-to)48-66
Number of pages19
JournalVLDB Journal
Volume7
Issue number1
DOIs
StatePublished - Feb 1998

Keywords

  • Data allocation
  • Disk cooling
  • File striping
  • Load balancing
  • Parallel disk systems
  • Performance tuning

ASJC Scopus subject areas

  • Information Systems
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Data partitioning and load balancing in parallel disk systems'. Together they form a unique fingerprint.

Cite this