May 3, 2023

May 3, 2023

Present

Gregg Barrett, Geoffrey Fox, Juri Papay, Christian Herwig, Mallikarjun Shankar, Wesley Brewer, Gregor von Laszewski, Piotr Luszczek, Christine Kirkpatrick

Tentative Agenda

• Any new members
• Benchmark Carpentry benchmark-carpentry
• AI Readiness of MLCommons Science (Continued) MLCommons Science FAIR Concept Paper
• Using Benchmarking Data to Inform Decisions Related to Machine Learning Resource Efficiency (Continued) mlcommons_data_energy_usage_paper
• Discussion of new Benchmarks (Continued)
• AOB

Using ORNL Supercomputers

• Summit will be replaced by Frontier based on AMD CPU and GPU
• Need to switch from CUDA to AMD HIP Introduction to HIP Programming Guide
• This could happen in next 6-8 months
• We discussed ways to get accounts which are suitable for different size and different length projects
• Collaboration with ORNL staff is the way we operate now
• Porting /exploring as we do can be supported by a Director’s Discretionary for a standalone MLCommons project
• The description and link for the Director's Discretionary (DD) allocation is at the link https://docs.olcf.ornl.gov/accounts/accounts_and_projects.html
• Large projects (not MLCommons) get ALCC (Leadership Computing Challenge) or Insight awards
• Ask Feiyi Wang

Papers

• Benchmark Carpentry paper could be combined with another paper Gregor is writing for Frontiers journal on HPC; this discusses power use
• Christine discussed power paper and asked what type of network is Candle UNO. Geoffrey thought it was a database like lookup mappring drug specifications to biological responseJuri is porting a PNNL single GPU code to many GPUs.
• We hoped to have a draft of this paper by the next meeting

New Benchmarks

• We discussed removing data engineering components of benchmarks such as earthquake one.
• We discussed OSMIBench with its new open dataset based on OpenFOAM and TensorFlowFoam (Argonne GitHub - argonne-lcf/TensorFlowFoam: Integrating the TensorFlow 1.15 C-API into OpenFOAM 5.0 for data-driven CFD algorithm development)
• we will discuss this UVA ORNL May 12
• Wes Brewer mentioned intereste in Digital Twins of Supercomputers – in particular Frontier to study Power. He will talk in detail next time. There will be an SC23 BOF
• Christian mentioned that FastML was collecting datasets for their Physics datasets. 3 have been fully formed. A student of Vijay Janapa Reddi and Bonn University are involved.

Meeting with David Kanter May 5 2023

• We are ready to go
• Linked up with Kelly MLCommons Science Blog post draft
• Need to advertise

April 20 2023 Community Meeting

Full set of slides 2023.04.20 MLCommons Community Meeting
Science WG slides MLCommons Science Working Group April 20 2023

April 2023 Change in Leadership

Note Juri Papay replaces Tony Hey as co-chair. Juri comes from STFC-UKRI as did Tony. Tony stepped down after a heroic effort starting up the working group – he has all our Thanks.