ScienceAgentBench (ICLR 2025)

github.com/osu-nlp-group/scienceagentbench
Active141updated 2 months ago
Python
MIT

102 executable tasks from 44 peer-reviewed papers across 4 disciplines with containerized evaluation

Sourced from

  • GitHub โ€” github.com/osu-nlp-group/scienceagentbench
  • Awesome AI for Science โ€” github.com/osu-nlp-group/scienceagentbench

Related resources

LLM agents across scientific domains

Idle941 year ago
MIT

Turn any AI agent into an AI Scientist. The #1 Agent Skills library for science with 140+ ready-to-use skills and 100+ scientific databases covering biology, chemistry, medicine, and drug discovery. Compatible with Cursor, Claude Code, Codex, Antigravity, and the open Agent Skills standard (K-Dense-AI, 26K+ stars, 2025)

Active30.6K2 days ago
Python
MIT

Comprehensive collection of 125+ ready-to-use scientific skill modules for Claude AI across bioinformatics, cheminformatics, clinical research, ML, and materials science

Active27.8K1 month ago
Python
MIT

Curated scientific LLM papers (260+ models)

Idle6601 year ago
MIT

Multi-LLM consensus framework for automated cell type annotation in single-cell transcriptomics, integrating predictions from 10+ large language models with iterative discussion and uncertainty quantification to reduce single-model biases, achieving up to 95% accuracy without reference datasets; available as CRAN R package and PyPI Python package with Scanpy/Seurat integration (2025)

Active6491 week ago
Python
MIT

First architecture deeply integrating a DNA foundation model with an LLM for multimodal biological reasoning, achieving 98% accuracy on KEGG disease pathway prediction and 15%+ average gains on variant effect prediction with interpretable step-by-step reasoning traces (bowang-lab, 390+ stars)

Active3981 month ago
Jupyter Notebook
Apache-2.0