National Science Data Fabric National Science
Data Fabric (NSDF) Join NSDF

NSDF • Products

National Science Data Fabric Products

NSDF Products

Journals and Juried Conference Papers

  • A. Panta, X. Huang, N. McCurdy, D. Ellsworth, A. Gooch, G. Scorzelli, H. Torres, P. Klein, G. Ovando-Montejo, V. Pascucci, Web-based Visualization and Analytics of Petascale data: Equity as a Tide that Lifts All Boats, LDAV: 13th IEEE Symposium on Large Data Analysis and Visualization, October 2024, To Appear, 10.48550/arXiv.2408.11831
  • Michela Taufer, Daniel Milroy, Todd Gamblin, Andrew Jones, Bill Magro, Heidi Poxon, and Seetharami Seelam. HPC and Cloud Convergence Beyond Technical Boundaries: Strategies for Economic Sustainability, Standardization, and Data Accessibility. IEEE Computer, 2024. 10.1109/MC.2024.3387013
  • Chaitanya Afle, Patrick Miles, Silvina Caino-Lores, Collin Capano, Ingo Tews, Karan Vahi, Ewa Deelman, Michela Taufer, and Duncan Brown. Reproducing the Results for NICER Observation of PSR J0030+0451. IEEE Computing in Science and Engineering (CiSE), pages 1–13, 2024. 10.1109/MCSE.2024.3381080
  • Camila Roa, Paula Olaya, Ricardo Llamas, Rodrigo Vargas, and Michela Taufer. GEOtiled: A Scalable Workflow for Generating Large Datasets of High-Resolution Terrain Parameters. In Proceedings of the 32nd International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), pages 1–2, Orlando, Florida, USA, June 2023. ACM. (Short paper) 10.1145/3588195.3595941
  • Camila Roa, Mats Rynge, Paula Olaya, Karan Vahi, Todd Miller, John Goodhue, James Griffioen, David Hudak, Shelley Knuth, Ricardo Llamas, Rodrigo Vargas, Miron Livny, Ewa Deelman, and Michela Taufer. End-to-end Integration of Scientific Workflows on Distributed Cyberinfrastructures: Challenges and Lessons Learned with an Earth Science Application. In Proceedings of the 15th IEEE/ACM International Conference on Utility and Cloud Computing (UCC), pages 1–10, Taormina (Messina), Italy, December 2023. IEEE Computer Society. 10.1145/3603166.3632142
  • Paula Olaya. Enabling Reproducibility, Scalability and Orchestration of Scientific Workflows in HPC and Cloud Infrastructure. PhD dissertation. University of Tennessee Knoxville. 2024. https://trace.tennessee.edu/utk_graddiss/10488
  • Danica L. Lombardozzi, William R. Wieder, Negin Sobhani, Gordon B. Bonan, David Durden, Dawn Lenz, Michael SanClements, Samantha Weintraub-Leff, Edward Ayres, Christopher R. Florian, Kyla Dahlin, Sanjiv Kumar, Abigail L. S. Swann, Claire Zarakas, Charles Vardeman, and Valerio Pascucci. Overcoming barriers to enable convergence research by integrating ecological and climate sciences: The NCAR-NEON system Version 1. EGUsphere 2023. PDF — 10.5194/egusphere-2023-271
  • Michela Taufer, Heberth Martinez, Jakob Luettgau, Lauren Whitnah, Giorgio Scorzelli, Pania Newell, Aashish Panta, Timo Bremer, Doug Fils, Christine R. Kirkpatrick, and Valerio Pascucci. Integrating FAIR Digital Objects into the National Science Data Fabric to Revolutionize Dataflows for Scientific Discovery. IEEE Computing in Science & Engineering. PDF
  • Jakob Luettgau, Paula Olaya, Heberth Martinez, Giorgio Scorzelli, Glenn Tarcea, Jay Lofstead, Christine Kirkpatrick, Valerio Pascucci, and Michela Taufer. NSDF-Services: Integrating Networking, Storage, and Computing Services into a Testbed for Democratization of Data Delivery. In Proceedings of the 15th IEEE/ACM International Conference on Utility and Cloud Computing (UCC), pages 1–10, Taormina (Messina), Italy, December 2023. IEEE Computer Society. — Slides
  • Jakob Luettgau, Heberth Martinez, Glenn Tarcea, Giorgio Scorzelli, Valerio Pascucci, and Michela Taufer. Studying Latency and Throughput Constraints for Geo-Distributed Data in the National Science Data Fabric. In Proceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing (HPDC '23). Association for Computing Machinery, New York, NY, USA, 325–326. June 2023. 10.1145/3588195.3595948
  • S. Leventhal, A. Gyulassy, V. Pascucci and M. Heimann, "Modeling Hierarchical Topological Structure in Scientific Images with Graph Neural Networks," 2023 IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, Malaysia, 2023, pp. 2995-2999. 10.1109/ICIP49359.2023.10222089
  • Paula Olaya, Jakob Luettgau, Naweiluo Zhou, Giorgio Scorzelli, Jay Lofstead, Valerio Pascucci, and Michela Taufer. NSDF-FUSE: A Testbed for Studying Object Storage via FUSE File Systems. In Proceedings of the 31st International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), pages 1–2, Minneapolis, Minnesota, June 2022. ACM. 10.1145/3502181.3533709
  • Glenn Tarcea, Brian Puchala, Tracy Berman, Giorgio Scorzelli, Valerio Pascucci, Michela Taufer, and John Allison. The Materials Commons Data Repository. In Proceedings of the 18th IEEE International Conference on e-Science (eScience), pages 1–2, Salt Lake City, Utah, USA, October 2022. IEEE Computer Society. 10.1109/eScience55777.2022.00060
  • D. Kennedy, P. Olaya, J. Lofstead, R. Vargas and M. Taufer, "Augmenting Singularity to Generate Fine-grained Workflows, Record Trails, and Data Provenance," 2022 IEEE 18th International Conference on e-Science (e-Science), Salt Lake City, UT, USA, 2022, pp. 403-404. 10.1109/eScience55777.2022.00059
  • A. Venkat et al., "High-Quality Progressive Alignment of Large 3D Microscopy Data," 2022 IEEE 12th Symposium on Large Data Analysis and Visualization (LDAV), Oklahoma City, OK, USA, 2022, pp. 1-10. 10.1109/LDAV57265.2022.9966406
  • Jakob Luettgau, Giorgio Scorzelli, Glenn Tarcea, Christine R. Kirkpatrick, Valerio Pascucci, and Michela Taufer. NSDF-Catalog: Lightweight Indexing Service for Democratizing Data Delivery. In Proceedings of the 15th IEEE/ACM International Conference on Utility and Cloud Computing (UCC), pages 1–10, Seattle, WA, USA, December 2022. IEEE Computer Society. 10.1109/UCC56403.2022.00011 — Slides
  • D. Hoang, H. Bhatia, P. Lindstrom and V. Pascucci, "Progressive Tree-Based Compression of Large-Scale Particle Data," in IEEE Transactions on Visualization and Computer Graphics. 10.1109/TVCG.2023.3260628
  • Jakob Luettgau, Giorgio Scorzelli, Valerio Pascucci, and Michela Taufer. 2023. Development of Large-Scale Scientific Cyberinfrastructure and the Growing Opportunity to Democratize Access to Platforms and Data. In Distributed, Ambient and Pervasive Interactions: 11th International Conference, DAPI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part I. Springer-Verlag, Berlin, Heidelberg, 378–389. 10.1007/978-3-031-34668-2_25
  • S. Leventhal, A. Gyulassy, M. Heimann and V. Pascucci, "Exploring Classification of Topological Priors with Machine Learning for Feature Extraction," in IEEE Transactions on Visualization and Computer Graphics. 10.1109/TVCG.2023.3248632
  • Naweiluo Zhou, Giorgio Scorzelli, Jakob Luettgau, Rahul R Kancharla, Joshua J Kane, Robert Wheeler, Brendan P Croom, Pania Newell, Valerio Pascucci, and Michela Taufer. 2023. Orchestration of materials science workflows for heterogeneous resources at large scale. Int. J. High Perform. Comput. Appl. 37, 3–4 (Jul 2023), 260–271. 10.1177/10943420231167800
  • Li, Zhimin and Menon, Harshitha and Mohror, Kathryn and Liu, Shusen and Guo, Luanzheng and Bremer, Peer-Timo and Pascucci, Valerio. "A Visual Comparison of Silent Error Propagation," in IEEE Transactions on Visualization and Computer Graphics. 10.1109/TVCG.2022.3230636
  • Ke Fan, Thomas Gilray, Valerio Pascucci, Xuan Huang, Kristopher Micinski, and Sidharth Kumar. 2022. Optimizing the Bruck Algorithm for Non-uniform All-to-all Communication. In Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing (HPDC '22). Association for Computing Machinery, New York, NY, USA, 172–184. 10.1145/3502181.3531468
  • Jakob Luettgau, Paula Olaya, Naweiluo Zhou, Giorgio Scorzelli, Valerio Pascucci, and Michela Taufer. NSDF-Cloud: Enabling Ad-Hoc Compute Clusters Across Academic and Commercial Clouds. In Proceedings of the 31st International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), pages 1–2, Minneapolis, Minnesota, June 2022. ACM. 10.1145/3502181.3533710
  • Morrical, Nate & Sahistan, Alper & Gudukbay, U. & Wald, Ingo & Pascucci, Valerio. (2022). Quick Clusters: A GPU-Parallel Partitioning for Efficient Path Tracing of Unstructured Volumetric Grids. IEEE Transactions on Visualization and Computer Graphics. PP. 1-11. 10.1109/TVCG.2022.3209418
  • McDonald, T. & Shrestha, Rebika & Yi, X. & Bhatia, Harsh & Chen, De & Goswami, D. & Pascucci, Valerio & Turbyville, T. & Bremer, Peer-Timo. (2021). Leveraging Topological Events in Tracking Graphs for Understanding Particle Diffusion. Computer Graphics Forum. 40. 251-262. 10.1111/cgf.14304
  • A. Venkat et al., "Towards replacing physical testing of granular materials with a Topology-based Model" in IEEE Transactions on Visualization & Computer Graphics, vol. 28, no. 01, pp. 76-85, 2022. 10.1109/TVCG.2021.3114819
  • Harsh Bhatia, Duong Hoang, Nate Morrical, Valerio Pascucci, Peer-Timo Bremer, and Peter Lindstrom. 2022. AMM: Adaptive Multilinear Meshes. IEEE Transactions on Visualization and Computer Graphics 28, 6 (June 2022), 2350–2363. 10.1109/TVCG.2022.3165392
  • K. Fan, D. Hoang, S. Petruzza, T. Gilray, V. Pascucci and S. Kumar, "Load-balancing Parallel I/O of Compressed Hierarchical Layouts," 2021 IEEE 28th International Conference on High Performance Computing, Data, and Analytics (HiPC), Bengaluru, India, 2021, pp. 343-353. 10.1109/HiPC53243.2021.00048
  • P. Klacansky, A. Gyulassy, P. -T. Bremer and V. Pascucci, "A Study of the Locality of Persistence-Based Queries and Its Implications for the Efficiency of Localized Data Structures," 2022 IEEE 15th Pacific Visualization Symposium (PacificVis), Tsukuba, Japan, 2022, pp. 121-130. 10.1109/PacificVis53943.2022.00021
  • N. Morrical, I. Wald, W. Usher and V. Pascucci, "Accelerating Unstructured Mesh Point Location With RT Cores," in IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 8, pp. 2852-2866, 1 Aug. 2022. 10.1109/TVCG.2020.3042930
  • Klacansky, Pavol and Miao, Haichao and Gyulassy, Attila and Townsend, Andrew and Champley, Kyle and Tringe, Joseph and Pascucci, Valerio and Bremer, Peer-Timo. "Virtual Inspection of Additively Manufactured Parts," 2022 IEEE 15th Pacific Visualization Symposium (PacificVis), Tsukuba, Japan, 2022, pp. 81-90. 10.1109/PacificVis53943.2022.00017

Conference Presentations and Papers

November 2023

Valerio Pascucci, Michela Taufer, Christine Kirkpatrick, and Jakob Luettgau (2023). BOF: A National Science Data Fabric to Democratize Data Access and Reusability. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC). Denver, Colorado. sc23.supercomputing.org — Slides

SC23 BOF

Valerio Pascucci, Michela Taufer, Ian Foster, Ilya Baldin, Franck Wuerthwein (2023). Panel: Unleashing the Power within Data Democratization: Needs, Challenges, and Opportunities International Conference for High Performance Computing, Networking, Storage, and Analysis (SC). Denver, Colorado. 12-17 November 2023. sc23.supercomputing.org

Slides
Slides
Slides

Daniel Milroy, Michela Taufer, Seetharami Seelam, Bill Magro, Heidi Poxon, Todd Gamblin. Panel: HPC and Cloud Converged Computing: Merging Infrastructures and Communities. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC). Denver, Colorado. Nov 2023 sc23.supercomputing.org

SC23 Panel

September 2023

Giorgio Scorzelli and Valerio Pascucci, NSDF@CHESS KNIT 7: A FABRIC Community Workshop. Columbus, OH. September 27-29 2023 whatisfabric.net — Slides

KNIT 7 Workshop

August 2023

Valerio Pascucci. The National Science Data Fabric Data-Joint Annual Workshop. Houston, TX. August 2023. datajoint.com

Data-Joint Workshop

July 2023

Natalie Meyers. FAIR Digital Objects in Distributed Research Environments. Throughput Computing 2023 OSG All Hands Meeting. Madison, WI. July 11 2023. agenda.hep.wisc.edu — Slides

Throughput Computing 2023

June 2023

Christine Kirkpatrick. National Science Data Fabric. Campus Research Computing Consortium's (CaRCC) Emerging Centers. June 6, 2023. carcc.org

CaRCC

Valerio Pascucci, The National Science Data Fabric: Democratizing Data Access for Science and Society, HIGH-PERFORMANCE COMPUTING SPECIAL EDITION An International Advanced Workshop, Cetraro Italy, June 26-30, 2023. hpcc.unical.it

HPC 2023

Kenton McHenry, Ongoing Impacts from the EarthCube Technical Efforts, Building Upon the EarthCube Community A GeoScience and Cyberinfrastructure workshop, June 27-28, 2023, Los Angeles CA. isi-usc-edu.github.io

EarthCube 2023

Paula Olaya, Jakob Luettgau, Camila Roa, Ricardo Llamas, Rodrigo Vargas, Sophia Wen, I-Hsin Chung, Seetharami Seelam, Yoonho Park, Jay Lofstead, and Michela Taufer. Enabling Scalability in the Cloud for Scientific Workflows: An Earth Science Use Case. In Proceedings of IEEE CLOUD, pages 1-10, Chicago, IL, USA, June 2023. IEEE Computer Society. conferences.computer.org

IEEE CLOUD 2023

V. Pascucci, G. Scorzelli, A. Gyulassy, O. Koppe, A. Panta, D. Hoang, P. Klacansky, S. Petruzza, P.-T. Bremer M. Taufer, P. Olaya, J. Luettgau, H. Martinez, J. Marquez J. Allison, G. Tarcea, F. Wuerthwein, C. Kirkpatrick, F. Andrijauskas, K. Coakley, J. Christopher-Ohlin, W. Sun, D. Bougie, K. Soloway, R. Verberg, S. Sarker, L. Smieska, A. Woll, K. Nygren, NSDF@CHESS: Democratizing Data, CHESS User Meeting & Workshops, June 6th 2023 Cornell. indico.classe.cornell.edu

CHESS 2023

V. Pascucci, G. Scorzelli, NSDF@CHESS Democratizing the Cornell Light Source, 2023 Research Infrastructure Workshop, Jun 26-30 2023, Washington DC. 2023riworkshop.events.whova.com

RI Workshop 2023

May 2023

Giorgio Scorzelli, Valerio Pascucci NSDF@CHESS Democratizing Data Access at the Cornell Light Source MERIF 2023 Workshop May 22-24, 2023 Boston, MA. sites.google.com

MERIF 2023

Michela Taufer, Jay Lofstead, Christine Kirkpatrick, Jakob Luettgau, and Valerio Pascucci. BOF: A National Science Data Fabric to Democratize Data Access and Reusability. May 2023. ISC High Performance Conference, May 24 2023, Hamburg, Germany.

ISC 2023

Glenn Tarcea, Materials Commons and FAIR Data, ICME 2023, May 22 2023, Caribe Royale Florida. tms.org

ICME 2023

Christine Kirkpatrick. Why FAIR is Worthwhile for Big Science & Easy Steps to Get Started. National Virtual Biosecurity Bioenergy Crops Center (NVBCC) Computing and Cross-Cutting Workshops. Virtual. May 2023.

April 2023

Valerio Pascucci Big Data Analytics for Decision Making Advanced Modeling and Simulation (AMS) Seminars. April 20, 2023. nas.nasa.gov

AMS Seminar

March 2023

Valerio Pascucci, The National Science Data Fabric: Democratizing Data Access for Science and Society, Jet Propulsion Laboratory Earth Science Seminar, March 13, 2023, La Canada Flintridge, CA. svcp.jpl.nasa.gov

JPL Seminar

December 2022

Valerio Pascucci, The National Science Data Fabric: Democratizing Data Access for Science and Society, Fall 2022 Colloquia Tulane University, Dec 8 2022, New Orleans, LA. sse.tulane.edu

Tulane Colloquium

November 2022

Christine Kirkpatrick. BoF: Bridging the HPC/Data Divide Supercomputing 2022 Conference. Dallas, TX, USA. 13-18 November 2022. sc22.supercomputing.org

SC22 BoF

Christine Kirkpatrick, John Goodhue, Melissa Cragin. Open Storage Network. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC). 13-18 November 2022. Dallas, 2022. sc22.supercomputing.org

SC22 Open Storage Network

Daniel Milroy, Marquita Ellis, Sameer Shende, Michela Taufer, Ward Harold, and Yan Fisher. Converged Computing: Bringing Together HPC and Cloud Communities. IEEE/ACM International Conference for High-Performance Computing, Networking, Storage, and Analysis. Nov 2022. sc22.supercomputing.org

SC22 Converged Computing

October 2022

Naweiluo Zhou, Jakob Luettgau, Rahul Reddy Kancharla, Joshua Kane, Brendan Croom, Robert Wheeler, Pania Newell, Giorgio Scorzelli, Valerio Pascucci, and Michela Taufer. A Software Framework for Scientific Workflow Orchestration at Large Scale. In Proceedings of the 18th IEEE International Conference on e-Science. Salt Lake City, Utah, USA. escience-conference.org

eScience 2022

Jakob Luettgau, Giorgio Scorzelli, Naweiluo Zhou, Glenn Tarcea, Jay Lofstead, Valerio Pascucci, and Taufer, Michela. Toward a Lightweight Indexing Service for the National Science Data Fabric In Proceedings of the 18th IEEE International Conference on e-Science (eScience). Salt Lake City, Utah, USA. October 2022. zenodo.org

eScience 2022 - Catalog

Owen Koppe, Giorgio Scorzelli, and Valerio Pascucci Unlocking Analysis Ready Cloud Optimized (ARCO) file format in the OpenVisus framework. Proceedings of the 18th IEEE International Conference on e-Science (eScience), Salt Lake City, Utah, USA, October 2022. IEEE Computer Society. zenodo.org

eScience 2022 - ARCO

September 2022

Jakob Luettgau, Giorgio Scorzelli, Glenn Tarcea, Christine Kirkpatrick, Valerio Pascucci, Michela Taufer, NSDF-Catalog: Toward a Lightweight Indexing Service for the National Science Data Fabric, 14th JLESC Workshop, 28-30 September 2022, Urbana, IL. publish.illinois.edu — Slides

JLESC Workshop

August 2022

Valerio Pascucci, The National Scientific Data Fabric, PRISMS Center Annual Workshop, August 9-12, 2022, Ann Arbor, Michigan. mse.engin.umich.edu

PRISMS Workshop

July 2022

Valerio Pascucci The National Science Data Fabric: Democratizing Data Access for Science and Society. HIGH-PERFORMANCE COMPUTING An International Advanced Workshop, July 4-8, 2022, Cetraro Italy. hpcc.unical.it

HPC 2022

November 2021

Valerio Pascucci, The National Science Data Fabric: Democratizing Data Access for Science and Society, APS Scientific Computation Seminar, November 29, 2021, Lemont, IL. anl.gov

Argonne APS Seminar

Software Repositories

NSDF Cornell CHESS

NSDF Dark Matter

NSDF Material Science Workflow

NSDF Material Commons

NSDF Automation Services

NSDF Cloud Services

NSDF Data Transfer Services

NSDF Fuse

NSDF Plugin

NSDF Catalog

NSDF Software Stack and Development Procedures

NSDF Web Site and Educational Materials

Data Repositories

Websites

Press Releases

NSDF Distinguished Speaker Series

Cornell CHESS

Joel Brock Big Data at Synchrotron X-ray User Facilities: Challenges and Opportunities NSDF Distinguished Speaker Series. December 12, 2023. Read more

Joel Brock

University of Hawai'i

Gwen Jacobs Cyberinfrastructure in Paradise: Enabling Science and Community Impact at the University of Hawaii NSDF Distinguished Speaker Series. Oct 19, 2023. Read more

Gwen Jacobs

UNESCO

Ana Persic, The Pathway to Implementing the UNESCO Recommendation on Open Science NSDF Distinguished Speaker Series. May 23, 2023. Read more

Ana Persic

INFN

Federica Legger Large (Hadron Collider) and Big (Data Science) NSDF Distinguished Speaker Series. March 23 2023. Read more

Federica Legger

Globus

Ian Foster A Global Research Data Platform: How Globus Services Enable Scientific Discovery NSDF Distinguished Speaker Series. May 26 2022. Read more

Ian Foster

Pangeo

Ryan Abernathey Pangeo Forge - Crowdsourcing Analysis Ready Data in the Cloud NSDF Distinguished Speaker Series. April 28 2022. Read more

Ryan Abernathey

NSDF All Hands Meetings

February 2022

Read more

  • Feb 2022 — University of Utah, Salt Lake City, UT
  • 3 concurrent Zoom meetings | 22 presentations | 44 participants (physical or virtual) | 6 round tables
  • Recordings and materials available online

October 2022

Read more

  • October 2022 — San Diego Supercomputer Center, San Diego, CA
  • 6 sessions | 40 participants (physical or virtual) | 28 presentations, 31 presenters
  • Recordings and materials available online

April 2023

Read more

  • April 2023 — San Diego Supercomputer Center, San Diego, CA
  • 6 sessions | 43 participants (physical or virtual) | 32 presentations
  • Recordings and materials available online
Ask NSDF We'd love to hear from you.