ScienceBoard (ICLR 2026)
github.com/os-copilot/scienceboardEvaluating multimodal autonomous agents in realistic scientific workflows across real scientific software environments (KAlgebra, Celestia, Grass GIS, Lean 4, etc.) with VM-based evaluation infrastructure and agent trajectories
Sourced from
- Awesome AI for Science — github.com/os-copilot/scienceboard
- GitHub — github.com/os-copilot/scienceboard
Related resources
High-accuracy RAG for scientific PDFs with citation support, agentic RAG, and contradiction detection
Official Jupyter extension with `%%ai` magic commands and sidebar chat assistant, connecting multiple model providers and local inference
Deep learning-based variant caller
Python Materials Genomics: robust materials analysis library defining classes for structures and molecules with support for many electronic structure codes; foundational toolkit powering the Materials Project (Berkeley Lab, 1.8K+ stars)
Benchmark evaluating AI agents on 75 curated Kaggle-style ML engineering competitions with reproducible Docker-based grading harness, human baselines, and end-to-end task lifecycle, used as a primary benchmark for autonomous ML research agents (e.g., InternAgent #1 at 36.44%)