January 8, 2025
January 8, 2025
Present
Geoffrey Fox, Andy Cheng, Armstrong Foundjem, Azza Ahmad, Briana Cervantes, Claus Weiland, Elie Alhajjar, Gregg Barrett, Juri Papay, Hussain Ather, Jeyan Thiyagalingam, Karen Bennet, Malek Ben Salem, Marco Colombo, Marisa Ahmad, Nhan Tran, Philip Harris, Piotr Luszczek, Riccardo Balin, Shirley Moore, Steven Farrell, Victor Lu, Vijay Janapa Reddi, Wes Brewer
Apologies
Gregor von Laszewski
Tentative Agenda
- Any New Members Introduction
- Setting Agenda for 2025
- White Papers
- Benchmark Carpentry benchmark-carpentry https://www.overleaf.com/project/67585323797c7e764c254a84
- MLCommons Science FAIR Concept Paper (AI Readiness) MLCommons Science FAIR Concept Paper
- Any Other Business
New Members
- Malek Ben Salem Malek Ben Salem, PhD - Accenture | LinkedIn Malek Ben Salem - IPWatchdog.com | Patents & Intellectual Property Law At Accenture, steering the helm of emerging technology, her focus lies on guiding C-suite clients through the complexities of adopting AI/ML, quantum and other emerging technologies securely. Her recent tenure has seen the birth of generative AI capabilities and the nurturing of global partnerships to train robust LLMs and AI agents. This role capitalizes on her expertise in AI/ML and her credentials in cybersecurity and technology architecture.
- The blend of her roles, as the Technology Research Director and now as the Managing Director, reflects a career dedicated to pioneering trustworthy AI. Through leadership and innovation, she delivered tools that fortify ML models against privacy threats and crafted quantum security solutions. Her path is one of creating responsible, impactful AI and security technologies that resonate across industries and borders.
- Syed Hussain Ather Syed Hussain Ather - MLCommons | LinkedIn AI Engineer - Research Scientist working across neuroscience, medical physics, educational technology, mixed reality, and other areas.
- Heuristic https://twitch.tv/hussainather
- Syed was a Physics undergraduate with Fox’s colleague Adam Szczepaniak, at Indiana University.
- Marco Colombo information was unfortunately not recorded
Discussion
- Juri Papay gave a Presentation mlCommons_08012025.pptx comparing performance of NVIDIA A100 and H100 with the AMD MI200 and MI300.
- Victor Lu noted PCIe bandwidth is asymmetrical between Host to Device and Device to Host - GPU - Hardware - NVIDIA Developer Forums in response to Juri’s slide 5 on asymmetric bandwidth host to device being much larger than device to host
- Philip Harris https://www.nsfhdr.org/mlchallenge described his anomaly detection benchmark challenge organized by the NSF HDR (Harnessing the Data Revolution)
- Vijay Janapa Reddi described the NSF POSE project led by Harvard and also involving the University of Tennessee and Virginia University
- Need to make a plan with goals and milestones over next two weeks
- Follow up meeting with Matt Sinclair, Christine, Gregor, Geoffrey. Matt has work on reproducibility that can be added to paper. This is the definition of reproducibility Christine uses - in short, an independent person on a different system getting a result that leads to the same conclusion. With ML, you will get different numbers as it were, but that can still represent reproducibility. https://ojs.aaai.org/index.php/AAAI/article/view/11503 see esp. fig 1.