September 4, 2024
September 4, 2024
Present
Juri Papay, Geoffrey Fox, Tues Day, Armstrong Foundjem, Gregg Barrett, Gregor von Laszewski, Victor Lu, Marisa Ahmad, Jineta Banerjee
Tentative Agenda
- Any New Members Introduction
- White Papers
- Using Benchmarking Data to Inform Decisions Related to Machine Learning Resource Efficiency https://docs.google.com/document/d/1gOKA8BnlJnsTAELWFSmL7Fl7kJej_UrNH-FVXbZFxGI/edit?usp=sharing Submitted (Christine Kirkpatrick)
- Benchmark Carpentry https://docs.google.com/document/d/15YIlAWOBA2_xjXkTnAZmaw003Jh4eqURVZYQHhdGYdQ/edit#heading=h.fa0u4qc1plw5
- AI Readiness of MLCommons Science https://docs.google.com/document/d/1NbL-VdkrY9jzPxveOys2RCK8TdEJ7O5wgnxjAgzK-rE/edit?usp=sharing
- Status of Benchmarks (OSMIBench, MOM6, Kaggle Calorimeter)
- Science Foundation Models
- Any Other Business
Discussion
- Geoffrey Fox, Jeyan Thiyagalingam, Piotr Luszczek and Tony Hey were at CCDSC meeting in Lyons France Workshop on Clusters, Clouds, and Data for Scientific Computing - 2024
- Their talks are
- Tony Hey Feynman and Computation: From Los Alamos to Quantum Computers
- Geoffrey Fox AI for Science Foundation Models and Patterns
- Piotr Luszczek Postmodern HPC: Scientific Library Patterns at the Dawn of Exascale
- Jeyan Thiyagalingam Mathematical Perspectives on AI and AI for Science
- Due to timing overlap with CCDSC talks, Juri led this meeting although Geoffrey was in attendance muted for the first 30 minutes.
- Marisa reported no change in the relation between HPC and Science working groups
- Gregor reported on the status of OSMI/MOM6 and Calorimeter benchmarks
- Juri presented an excel spreadsheet for the characterisation of ML applications which he uses for a quick "back of the envelope" calculations. There are numerous assumptions in the spreadsheet that need to be validated. In particular the HPC Bernchmark DeepCAM was analysed with picture below. The purpose of this spreadsheet is to provide a framework for reasoning about the runtime and bottlenecks in the application, and also to perform various what if studies.
- Followup conversations between Gregor and Juri discussed details of OSMI in the spirit of this spreadsheet
![][image1]