Logo image
Replicating HPC I/O Workloads With Proxy Applications
Conference proceeding

Replicating HPC I/O Workloads With Proxy Applications

James Dickson, Steven Wright, Satheesh Maheswaran, Andy Herdman, Mark C. Miller and Stephen Jarvis
PROCEEDINGS OF PDSW-DISCS 2016 - 1ST JOINT INTERNATIONAL WORKSHOP ON PARALLEL DATA STORAGE AND DATA INTENSIVE SCALABLE COMPUTING SYSTEMS, pp.13-18
01/01/2016

Abstract

Computer Science Computer Science, Hardware & Architecture Science & Technology Technology
Large scale simulation performance is dependent on a number of components, however the task of investigation and optimization has long favored computational and communication elements above I/O. Manually extracting the pattern of I/O behavior from a parent application is a useful way of working to address performance issues on a per-application basis, but developing workflows with some degree of automation and flexibility provides a more powerful approach to tackling current and future I/O challenges. In this paper we describe a workload replication workflow that extracts the I/O pattern of an application and recreates its behavior with a flexible proxy application. We demonstrate how simple lightweight characterization can be translated to provide an effective representation of a physics application, and show how a proxy replication can be used as a tool for investigating I/O library paradigms.

Metrics

Details

Logo image

Usage Policy