Index of Benchmarks

medium-range forecasting ERA5 data-driven

ClimateLearn - Weather Forcasting

Climate & Earth Science • Sequence Prediction/Forecasting

Avg rating: 5.00/5

medium-range forecasting ERA5 data-driven

ClimateLearn - Downscaling

Climate & Earth Science • Regression

Avg rating: 5.00/5

medium-range forecasting ERA5 data-driven

ClimateLearn - Climate Projection

Climate & Earth Science • Regression

Avg rating: 5.00/5

neural operators CFD FNO DeepONet

CFDBench (Fluid Dynamics)

Mathematics • Regression

Avg rating: 3.33/5

land-use zero-shot multi-task

SatImgNet

Climate & Earth Science • Multimodal Reasoning

Avg rating: 3.83/5

quantum circuits state preparation error correction

Quantum Computing Benchmarks (QML)

Computational Science & AI • Classification

Avg rating: 3.17/5

DFT relaxations adsorption energy graph neural networks

OCP (Open Catalyst Project)

Chemistry, Materials Science • Regression

Avg rating: 4.17/5

USMLE diagnostic QA medical knowledge multilingual

MedQA

Biology & Medicine • Reasoning & Generalization

Avg rating: 3.50/5

DFT materials genome high-throughput

Materials Project

Materials Science • Regression

Avg rating: 1.92/5

Google-proof graduate-level science QA chemistry physics

GPQA Diamond

Biology & Medicine, Chemistry, High Energy Physics • Reasoning & Generalization

Avg rating: 3.83/5

grade-school science QA challenge set reasoning

ARC-Challenge (Advanced Reasoning Challenge)

Computational Science & AI • Reasoning & Generalization

Avg rating: 4.83/5

symbolic reasoning number theory algebraic geometry category theory

FrontierMath

Mathematics • Reasoning & Generalization

Avg rating: 2.50/5

code synthesis scientific computing programming benchmark

SciCode

Computational Science & AI • Generative

Avg rating: 4.50/5

algebra combinatorics number theory geometry

AIME (American Invitational Mathematics Examination)

Mathematics • Reasoning & Generalization

Avg rating: 2.33/5

calculus algebra number theory geometry

PRM800K

Mathematics • Reasoning & Generalization

Avg rating: 3.83/5

long-context information extraction multimodal

CURIE (Scientific Long-Context Understanding, Reasoning and Information Extraction)

Materials Science, High Energy Physics, Biology & Medicine, Chemistry, Climate & Earth Science • Reasoning & Generalization

Avg rating: 3.33/5

finite element simulation PDE

FEABench (Finite Element Analysis Benchmark): Evaluating Language Models on Multiphysics Reasoning Ability

Mathematics • Reasoning & Generalization

Avg rating: 3.83/5

multimodal QA figure understanding table comprehension chain-of-thought

SPIQA (Scientific Paper Image Question Answering)

Computational Science & AI • Multimodal Reasoning

Avg rating: 3.67/5

single-cell annotation biological QA autonomous discovery

BaisBench (Biological AI Scientist Benchmark) - Question Answering

Biology & Medicine • Reasoning & Generalization

Avg rating: 4.00/5

single-cell annotation biological QA autonomous discovery

BaisBench (Biological AI Scientist Benchmark) - Cell Type Annotation

Biology & Medicine • Classification

Avg rating: 4.00/5

SELFIES GAN property optimization

MOLGEN

Chemistry • Generative

Avg rating: 4.83/5

node prediction link prediction graph classification

Open Graph Benchmark (OGB) - Biology

Biology & Medicine • Sequence Prediction/Forecasting

Avg rating: 4.83/5

classification real-time ML jet tagging QKeras

Jet Classification

High Energy Physics • Classification

Avg rating: 4.17/5

compression autoencoder sparse data irregular sampling

Irregular Sensor Data Compression

High Energy Physics • Generative

Avg rating: 4.17/5

RL beam stabilization control systems simulation

Beam Control

High Energy Physics • Reinforcement Learning/Control

Avg rating: 3.00/5

jet classification FPGA quantization-aware training Deep Sets Interaction Networks

Ultrafast jet classification at the HL-LHC

High Energy Physics • Classification

Avg rating: 3.17/5

quench detection autoencoder anomaly detection real-time

Quench detection

High Energy Physics • Anomaly Detection

Avg rating: 2.17/5

FPGA Graph Neural Network hls4ml real-time inference detector control

Intelligent experiments through real-time AI

High Energy Physics • Classification

Avg rating: 3.00/5

neural architecture search FPGA deployment quantization pruning hls4ml

Neural Architecture Codesign for Fast Physics Applications

High Energy Physics • Classification

Avg rating: 3.83/5

smart pixel on-sensor inference data reduction trigger

Smart Pixels for LHC

High Energy Physics • Classification

Avg rating: 3.33/5

BraggNN diffraction peak finding HEDM

HEDM (BraggNN)

Materials Science • Classification

Avg rating: 3.17/5

4D-STEM electron microscopy real-time image processing

4D-STEM

Materials Science • Classification

Avg rating: 3.17/5

plasma in-situ vision real-time ML

In-Situ High-Speed Computer Vision

High Energy Physics • Classification

Avg rating: 1.50/5

MLPerf HPC - Cosmoflow

High Energy Physics • Regression

Avg rating: 4.17/5

MLPerf HPC - DeepCAM

Climate & Earth Science • Classification

Avg rating: 4.17/5

MLPerf HPC - Open Catalyst Project DimeNet++

Chemistry • Regression

Avg rating: 4.17/5

MLPerf HPC - OpenFold

Biology & Medicine • Sequence Prediction/Forecasting

Avg rating: 4.17/5

MLCommons Science - CloudMask

Climate & Earth Science • Classification

Avg rating: 5.00/5

MLCommons Science - Earthquake

Climate & Earth Science • Sequence Prediction/Forecasting

Avg rating: 5.00/5

MLCommons Science - Candle UNO

Biology & Medicine • Classification

Avg rating: 5.00/5

MLCommons Science - STEMDL

Materials Science • Classification

Avg rating: 5.00/5

anomaly detection proton collision real-time inference event filtering unsupervised ML

LHC New Physics Dataset

High Energy Physics • Anomaly Detection

Avg rating: 3.33/5

medical AI federated evaluation privacy-preserving fairness healthcare benchmarks

MLCommons Medical AI - Pancreas Segmentation (DFCI)

Biology & Medicine • Classification

Avg rating: 4.33/5

medical AI federated evaluation privacy-preserving fairness healthcare benchmarks

MLCommons Medical AI - Brain Tumor Segmentation (BraTS)

Biology & Medicine • Classification

Avg rating: 4.33/5

medical AI federated evaluation privacy-preserving fairness healthcare benchmarks

MLCommons Medical AI - Surgical Workflow Phase Recognition (SurgMLCube)

Biology & Medicine • Classification

Avg rating: 4.33/5

calorimeter simulation generative models surrogate modeling LHC fast simulation

CaloChallenge 2022

High Energy Physics • Generative

Avg rating: 4.50/5

PDEs CFD scientific ML surrogate modeling NeurIPS

PDEBench

Computational Science & AI, Climate & Earth Science, Mathematics • Regression

Avg rating: 4.50/5

density functional theory Delta Squared-ML correction reaction energetics quantum chemistry

Delta Squared-DFT

Chemistry, Materials Science • Regression

Avg rating: 3.83/5

Urban Data Layer (UDL) - PM2.5 Concentration Prediction

Climate & Earth Science • Regression

Avg rating: 4.50/5

Urban Data Layer (UDL) - Built-up Area Classification

Climate & Earth Science • Classification

Avg rating: 4.50/5

Urban Data Layer (UDL) - Administrative Boundaries Identification

Climate & Earth Science • Classification

Avg rating: 4.50/5

Urban Data Layer (UDL) - El Nino Anomaly Detection

Climate & Earth Science • Anomaly Detection

Avg rating: 4.50/5

crop science prompt engineering domain adaptation question answering

LLMs for Crop Science

Climate & Earth Science • Reasoning & Generalization

Avg rating: 4.67/5

DUNE time-series real-time trigger

DUNE

High Energy Physics • Anomaly Detection

Avg rating: 2.83/5

mass spectrometry molecular structure de novo generation retrieval dataset

MassSpecGym - De novo molecule generation

Chemistry • Generative

Avg rating: 3.75/5

mass spectrometry molecular structure de novo generation retrieval dataset

MassSpecGym - Molecule Retrieval

Chemistry • Regression

Avg rating: 3.75/5

mass spectrometry molecular structure de novo generation retrieval dataset

MassSpecGym - Spectrum Simulation

Chemistry • Regression

Avg rating: 3.75/5

anomaly detection gravitational waves astrophysics time-series

HDR ML Anomaly Challenge - Gravitational Waves

High Energy Physics • Anomaly Detection

Avg rating: 4.17/5

anomaly detection computer vision genomics butterfly hybrids

HDR ML Anomaly Challenge - Butterfly

Biology & Medicine • Anomaly Detection

Avg rating: 3.00/5

anomaly detection climate science sea-level rise time-series remote sensing

HDR ML Anomaly Challenge - Sea Level Rise

Climate & Earth Science • Anomaly Detection

Avg rating: 3.83/5

qubit readout hls4ml FPGA QICK

Single Qubit Readout on QICK System

Computational Science & AI • Classification

Avg rating: 3.50/5

Google-proof multiple-choice expert reasoning science QA

GPQA: A Graduate-Level Google-Proof Question and Answer Benchmark

Biology & Medicine, High Energy Physics, Chemistry • Reasoning & Generalization

Avg rating: 3.67/5

sonar imagery vision-language seafloor mapping segmentation QA

SeafloorAI

Climate & Earth Science • Classification

Avg rating: 4.33/5

sonar imagery vision-language seafloor mapping segmentation QA

SeafloorGenAI

Climate & Earth Science • Reasoning & Generalization

Avg rating: 4.33/5

superconductivity crystal structures equivariant GNN generative models

SuperCon3D - Property Prediction

Materials Science • Regression

Avg rating: 4.17/5

superconductivity crystal structures equivariant GNN generative models

SuperCon3D - Inverse Crystal Structure Generation

Materials Science • Generative

Avg rating: 4.17/5

geometric deep learning distribution shift OOD robustness scientific applications

GeSS - Track Pileup

High Energy Physics • Classification

Avg rating: 4.33/5

geometric deep learning distribution shift OOD robustness scientific applications

GeSS - Track Signal

High Energy Physics • Classification

Avg rating: 4.33/5

geometric deep learning distribution shift OOD robustness scientific applications

GeSS - DrugOOD

Biology & Medicine • Classification

Avg rating: 4.33/5

geometric deep learning distribution shift OOD robustness scientific applications

GeSS - QMOF

Materials Science • Regression

Avg rating: 4.33/5

source localization bioacoustics time-series SSL

Vocal Call Locator (VCL)

Biology & Medicine • Regression

Avg rating: 3.83/5

multimodal QA scientific figures image+text chain-of-thought prompting

SPIQA (LLM)

Computational Science & AI • Multimodal Reasoning

Avg rating: 4.42/5

surrogate modeling foundation model physics simulations spatiotemporal dynamics

The Well

Biology & Medicine, Computational Science & AI, High Energy Physics • Sequence Prediction/Forecasting

Avg rating: 4.00/5