Title: [YV08] ParColl: Partitioned Collective IO on the Cray XT.
Year: 2008
Location: The 37th International Conference on Parallel Processing. 2008.
Author(s): W. Yu, J.S. Vetter.
Publication Type:Regular Publication
Abstract. This paper presents an extensive characterization, tuning, and optimization of parallel I/O on the Cray XT supercomputer, named Jaguar, at Oak Ridge National Laboratory. We have characterized the performance and scalability for different levels of storage hierarchy including a single Lustre object storage target, a single S2A storage couplet, and the entire system. Our analysis covers both data- and metadata-intensive I/O patterns. In particular, for small, non-contiguous dataintensive I/O on Jaguar, we have evaluated several parallel I/O techniques, such as data sieving and twophase collective I/O, and shed light on their effectiveness. Based on our characterization, we have demonstrated that it is possible, and often prudent, to improve the I/O performance of scientific benchmarks and applications by tuning and optimizing I/O. For example, we demonstrate that the I/O performance of the S3D combustion application can be improved at large scale by tuning the I/O system to avoid a bandwidth degradation of 49% with 8192 processes when compared to 4096 processes. We have also shown that the performance of Flash I/O can be improved by 34% by tuning the collective I/O parameters carefully.


You are here:   SDMCenter/Publications/TV08
Last Updated r1 on 2009-04-07 14:17:25 by Asim