Title: [NLC08] Scaling Parallel I/O Performance through I/O Delegate and Caching System
Year: 2008
Location: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis , Austin, Texas, November 2008.
Author(s): Arifa Nisar, Wei-keng Liao and Alok Choudhary
Publication Type:Regular Publication
Abstract Increasingly complex scientific applications require massive parallelism to achieve the goals of fidelity and high computational performance. Such applications periodically offload checkpointing data to file system for post-processing and program resumption. As a side effect of high degree of parallelism, I/O contention at servers does not allow overall performance to scale with increasing number of processors. To bridge the gap between parallel computational and I/O performance, we propose a portable MPI-IO layer where certain tasks, such as file caching, consistency control, and collective I/O optimization are delegated to a small set of compute nodes, collectively termed as I/O Delegate nodes. A collective cache design is incorporated to resolve cache coherence and hence alleviates the lock contention at I/O servers. By using popular parallel I/O benchmark and application I/O kernels, our experimental evaluation indicates considerable performance improvement with a small percentage of compute resources reserved for I/O.


You are here:   SDMCenter/Publications/NLC08
Last Updated r1 on 2009-04-07 14:12:20 by Asim