StructEval (TMLR 2025)
github.com/tiger-ai-lab/structevalBenchmark for evaluating LLM-generated structural outputs (Matplotlib, Vega, SVG, TikZ, and web UI code) with rendering-based and visual consistency checks ([paper](https://openreview.net/forum?id=buDwV7LUA7), TIGER-AI-Lab)
Sourced from
- Awesome AI for Science — github.com/tiger-ai-lab/structeval
- GitHub — github.com/tiger-ai-lab/structeval
Related resources
Curated, accuracy-first collection of benchmarks for evaluating LLMs on scientific reasoning and discovery across mathematics, physics, chemistry, materials science, biology, and agentic science (subinium, 29+ stars, MIT License, 2026)
A benchmarking platform for molecular generation models.
Large-scale benchmark suite for protein fitness prediction and design, aggregating 200+ deep mutational scanning assays and clinical variant datasets across diverse protein families and taxa, with standardized zero-shot and supervised leaderboards for variant effect prediction, mutation effect prediction, and protein language model evaluation (OATML & Marks Lab, NeurIPS 2023 Spotlight, Datasets & Benchmarks)
Scientific machine learning benchmarks & differential equation solvers
Unified benchmarking framework for protein representation learning, providing standardized interfaces for pre-training and diverse downstream tasks including structure prediction, fitness prediction, and property prediction across multiple protein datasets and model architectures (ICLR 2024, 273+ stars, MIT License)