In-network data caching

Current status (7/2022)

One ESnet XCache node at Sunnyvale CA is deployed as part of Southern California Petabyte Scale Cache for US CMS, an LHC High Energy Physics experiment, in collaboration with UCSD.
Two ESnet nodes at Chicago, IL and Boston, MA are being deployed for US CMS.
Two additional nodes for science use cases are plannned in CY 2023 in collaboration with Open Science Data Federation.

Publications

R. Han, A. Sim, K. Wu, I. Monga, C. Guok, F. Wurthwein, D. Davila, J. Balcas, H. Newman, "Access Trends of In-network Cache for Scientific Data", 5th ACM International Workshop on System and Network Telemetry and Analysis (SNTA 2022). doi:10.1145/3526064.3534110. http://arxiv.org/abs/2205.05563
A. Sim, E. Kissel, C. Guok, "Deploying in-network caches in support of distributed scientific data sharing", the US Community Study on the Future of Particle Physics (Snowmass 2021), 2022. doi:/10.48550/arXiv.2203.06843. https://arxiv.org/abs/2203.06843
E. Copps, A. Sim (Advisor), K. Wu (Advisor), "Analyzing scientific data sharing patterns with in-network data caching", ACM Richard Tapia Celebration of Diversity in Computing (TAPIA 2021), ACM Student Research Competition (SRC), 2021. Summary and slides.
E. Copps, H. Zhang, A. Sim, K. Wu, I. Monga, C. Guok, F. Wurthwein, D. Davila, E. Fajardo, "Analyzing scientific data sharing patterns with in-network data caching", 4th ACM International Workshop on System and Network Telemetry and Analysis (SNTA 2021), 2021, doi:10.1145/3452411.3464441. http://arxiv.org/abs/2105.00964

Presentations

Presentation (7/22/2022), "Network and Cache Utilization Trends of Regional Scientific Data Cache for US-CMS SoCal HEP Analysis Jobs" - Summary of 1-year measurement data from SoCal Repo, ACM/IEEE The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC22), ACM Student Research Competition (SRC), 2022.
Presentation (5/25/2022), "Data Access Trends in Southern California Petabyte Scale Cache", DOMA general meeting, 2022. https://indico.cern.ch/event/1161067/
News article (9/20/2021), "In-Network Caching Shown to Enhance Science Community's Access to Experimental Data", Energy Sciences Network, 2021. https://www.es.net/news-and-publications/esnet-news/2021/berkeley-lab-and-esnet-pioneer-in-network-caching-model
Presentation (2/23/2021), In-network data caching, US CMS Blueprint meeting, 2021. https://indico.cern.ch/event/925536/
Presentation (2/10/2021), "Exploring in-network data caching, ESnet-USCMS collaboration study", WLCG GDB meeting, 2021. https://indico.cern.ch/event/876773/