Publication
Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems
Authors
Patel, Tirthak; Byna, Surendra; Lockwood, Glenn; Wright, Nicholas; Carns, Philip; Ross, Robert; Tiwari, Devesh
Abstract
Large-scale high-performance computing (HPC) applications running on supercomputers produce large amounts of data routinely and store it in files on multi-PB shared parallel storage systems. Unfortunately, storage community has a limited understanding of the access and reuse patterns of these files. This paper investigates the access and reuse patterns of I/O-intensive files on a production-scale supercomputer.