[View PDF]

 

Glean

GLEAN is a flexible and extensible framework to facilitate simulation-time data analysis and I/O acceleration.

Features include: topology-aware data movement, asynchronous data staging and burst buffering, leverages application data models, scalable analysis algorithms and infrastructure (in situ, co processing, in flight).

Scaled to entire ALCF infrastructure (160K BG/P Intrepid cores), achieved multi-fold I/O improvement for FLASH, and demonstrated in situ analysis.