Meeting Notes - March 10, 2026
March 10, 2026 (9.05 pm. ET for Asia-USA)
Present
- Bettaieb Walid, Gary Mazzaferro, Geoffrey Fox, Gregor von Laszewski, Satoshi Iwata, Tues Day, Victor Lu
New Member
- Walid Bettaieb from Tunisia https://www.linkedin.com/in/bettaiebwalid12/, He is currently an embedded system engineering student, and really passioned about embedded systems, and space sience. Eager to learn from you all and as well contribute if possible. It is 2 am in Tunisia timeline
Meeting Notes
-
Stakeholder review progress and taxonomy development were discussed with the introduction of a new member and a key decision to decline the Earth Science special edition offer.
-
Stakeholder Review and Taxonomy\ Work is progressing on the stakeholder review paper, which will be published this week, allowing the group to begin developing a necessary taxonomy for benchmarks. The group agreed to use the ACM or IEEE format for the paper, prioritizing the ACM format for easier management.
-
Project Updates and Decisions\ The time series dataset catalog is complete with 804 datasets, and the next step is to write up the findings. The group decided to decline the offer from Frontiers to organize a special edition on Earth Science due to insufficient internal expertise.
-
Performance and Standardization Discussion\ A discussion on data processing performance confirmed that the underlying file system is often the bottleneck, with ZFS showing a 75% performance improvement over ext4 in a large dataset test. It was proposed that SNIA help map out various scheduling layers from user level to hardware level to guide future benchmark design.
Discussion
-
Tues Day noted 2026 AI Knowledge Assessment.Here's a stakeholder survey with chat features - any thoughts on FOrmally as a survey platform?
-
Gary Mazzaferro appreciated link
-
She noted one more,Gary! My paper was accepted to ICLR 2026 https://ml-for-rs.github.io/iclr2026/
-
A Benchmark Bill of Materials for Multicultural, Multimodal Remote Sensing: Auditing Foundation Model Evaluation
-
Bettaieb Walid congratulated Tues who said “thanks! really interested in embedded systems with remote sensors”
-
Heres Tues Day’s labs handbook in progress https://benchmarkhandbook.manus.space/
- Geoffrey will study
-
Tues Day’s study of Agentic Benchmarks Agentic Benchmarks from TUESDAY
-
Data Formats Victor Lu https://justsolve.archiveteam.org/index.php/Scientific_Data_formats modified to http://fileformats.archiveteam.org/wiki/Scientific_Data_formats by Gregor
-
Gary Mazzaferro http://fileformats.archiveteam.org/wiki/Electronic_File_Formats
-
Victor Lu Data aspect of Scientific AI Benchmarks
-
Gregor von Laszewski suggested Gary check out LVM+XFS/EXT4
-
on plain linux i am sure you use right now command zfs
-
Tues Day noted Earth Engine! https://earthengine.google.com/platform/
-
Geoffrey shared Time Series Features.pdf with Gary