Find open-source science resources

Universal 3D molecular pretraining framework with 209M conformations, scaling to 1.1B parameters (Uni-Mol2) on 800M conformations for molecular property prediction, docking, and quantum chemistry (ICLR 2023, NeurIPS 2024)

RNA foundation model trained on millions of RNA sequences for generalist RNA sequence understanding, enabling downstream structure prediction, function annotation, and representation learning for non-coding RNAs (ml4bio, 372+ stars)

State-of-the-art pretrained language models for proteins trained on thousands of GPUs and Google TPUs using Transformer architectures, enabling protein property prediction, feature extraction, and transfer learning across diverse downstream tasks (1.3K+ stars, MIT, 2020-2026)

Diffusion-based molecular docking achieving SOTA blind docking performance, treating ligand pose prediction as generative diffusion over SE(3), with DiffDock-L update for improved generalization (MIT CSAIL, ICLR 2023)

Unified benchmarking framework for protein representation learning, providing standardized interfaces for pre-training and diverse downstream tasks including structure prediction, fitness prediction, and property prediction across multiple protein datasets and model architectures (ICLR 2024, 273+ stars, MIT License)

PyTorch implementation of neural ODEs

Neural optical understanding for academic documents, transforms scientific PDFs to Markdown with mathematical formula support

Microsoft's AI-powered ab initio biomolecular dynamics simulation achieving quantum-mechanical accuracy for proteins with 10,000+ atoms, orders of magnitude faster than DFT using protein fragmentation and ML force fields (Nature 2024)

Versatile multi-temporal geospatial foundation model for Earth observation, built on a ViT-based masked autoencoder with 3D spatiotemporal patch embeddings and geolocation/temporal metadata encoding; pretrained on 4.2M global time-series samples from NASA's Harmonized Landsat and Sentinel-2 archive at 30m resolution, with 300M/600M parameter variants and fine-tuning configs for flood detection, wildfire scar, landslide detection, crop segmentation, land cover, and biomass estimation (258+ stars, MIT License)

Equivariant graph attention Transformer (ICLR2023)

Extension of ProteinMPNN for protein sequence design in the context of small-molecule ligands, metal ions, and nucleic acids, enabling binding site engineering and co-factor redesign (Baker Lab)

Geometric deep learning model predicting transcriptional outcomes of novel single- and multi-gene perturbations using gene–gene knowledge graphs, 40% higher precision than prior methods on combinatorial perturbation prediction (Stanford, Nature Biotechnology 2024)

LLM for scientific research papers

Kolmogorov-Arnold Networks with learnable activation functions on edges instead of fixed node activations, achieving strong performance in function fitting, PDE solving, and scientific discovery with enhanced interpretability as an alternative to MLPs (MIT, 16.3K+ stars, 2024)

LLM agents across scientific domains

Large-scale biomolecular instruction dataset for chemistry/biology LLMs (ICLR2024)

Chemical language model

Materials informatics benchmark

Web application for LLM-assisted manuscript review and annotation

Deep learning-based protein sequence design (inverse folding) from backbone structures, achieving 52.4% sequence recovery vs 32.9% for Rosetta, core tool in modern protein design pipelines (Baker Lab, Science 2022)

Structure-aware prefix adaptation for integrating LLMs with knowledge graphs (ACM MM 2024)

Biomedical text generation

Climate data benchmark for ML models

Open language model for mathematics (7B/34B) trained on Proof-Pile-2, outperforming Minerva at equal scale on MATH benchmark, with tool use and formal theorem proving in Lean without finetuning (EleutherAI, ICLR 2024)

Physics-informed ML and SciML

PINN research collection

Weather prediction benchmark

Secure text-to-visualization through standardized chart specifications

First foundation model for weather and climate by Microsoft, Vision Transformer-based architecture trained on heterogeneous datasets (ICML 2023)

Spherical CNNs for astronomy

Crystal property prediction