Parallel disk systems provide opportunities for high performance I/O by supporting efficiently intra-request and inter-request parallelism. We review briefly the components of an intelligent file manager that performs striping on an individual file basis and achieves load balancing by judicious file allocation and dynamic redistribution of the data. The main part of the paper discusses our "disk cooling" procedure for dynamic redistribution of data which is based on reallocation of file fragments. We show that this heuristic method achieves excellent load balance in the presence of evolving access patterns. We report on two sets of experiments: a synthetic experiment which exhibits a self-similar skew in the data access patterns and a trace-based experiment where we study the impact of the file fragment size on the cooling procedure. 1 Introduction Parallel disk systems are of great importance to massively parallel computers since they are scalable and they can ensure that I/O is not ...
|Journal||Institute of Electrical and Electronics Engineers Data Engineering Bulletin|
|State||Published - Sep 1994|