Find open-source science resources

Unified benchmarking framework for protein representation learning, providing standardized interfaces for pre-training and diverse downstream tasks including structure prediction, fitness prediction, and property prediction across multiple protein datasets and model architectures (ICLR 2024, 273+ stars, MIT License)

Efficient foundation models for PDEs with pretrained transformer-based neural operators and downstream task fine-tuning pipelines, HuggingFace integration for models and datasets (ETH Zurich CAMLab, arXiv 2024)

PyTorch implementation of neural ODEs

LLM-based molecular optimization tool

Vision-language pathology foundation model using contrastive learning on histopathology image-text pairs, enabling zero-shot classification, slide-level retrieval, and multimodal reasoning across diverse cancer types (Mahmood Lab, 494+ stars)

Minimal-modification vision transformer for skillful and reliable medium-range weather forecasting, introducing weather-specific patch embedding, randomized dynamics forecasting over varying time intervals, and pressure-weighted loss; competitive at short range and outperforming prior methods beyond 7 days on WeatherBench 2 with orders-of-magnitude less training data and compute, with favorable scaling in model size and training tokens (MIT License)

Neural optical understanding for academic documents, transforms scientific PDFs to Markdown with mathematical formula support

Generate comprehensive reviews from arXiv papers and convert to blog posts

Microsoft's AI-powered ab initio biomolecular dynamics simulation achieving quantum-mechanical accuracy for proteins with 10,000+ atoms, orders of magnitude faster than DFT using protein fragmentation and ML force fields (Nature 2024)

Equivariant graph attention Transformer (ICLR2023)

Extension of ProteinMPNN for protein sequence design in the context of small-molecule ligands, metal ions, and nucleic acids, enabling binding site engineering and co-factor redesign (Baker Lab)

Physics-AI hybrid modeling for fine-grained weather forecasting (NeurIPS'24)

Geometric deep learning model predicting transcriptional outcomes of novel single- and multi-gene perturbations using gene–gene knowledge graphs, 40% higher precision than prior methods on combinatorial perturbation prediction (Stanford, Nature Biotechnology 2024)

Open-source medical large language model for complex clinical reasoning, extending the o1 long-chain-of-thought paradigm to biomedical question answering and diagnostic inference (FreedomIntelligence, 1.3K+ stars)

Comprehensive toolkit for high-quality PDF content extraction with layout detection, formula recognition, and OCR

Single-cell transformer foundation model pretrained on 104M human transcriptomes via masked gene prediction, enabling transfer learning for cell type classification, gene network analysis, and in silico perturbation with limited labeled data (Nature 2023, V2 2024)

Large-scale biomolecular instruction dataset for chemistry/biology LLMs (ICLR2024)

Large Language Models for automated open-domain scientific hypotheses discovery (ACL 2024, ICML Best Poster)

Universal chart comprehension and reasoning model

Transform arXiv research papers into engaging presentations and YouTube-ready videos

Materials informatics benchmark

Convert PDF files into editable slides with three lines of code

Structure-aware prefix adaptation for integrating LLMs with knowledge graphs (ACM MM 2024)

Powerful and flexible machine learning platform for drug discovery, providing comprehensive tools for molecular property prediction, generative models, knowledge graph reasoning, and reaction prediction with PyTorch backend (1.5K+ stars)

Diffusion model for scalable protein structure design with multi-motif scaffolding capabilities, achieving state-of-the-art designability, diversity, and novelty through SE(3)-equivariant attention and massive data augmentation (AlQuraishi Lab, 2024)

Automated data visualization with minimal code

Multi-disciplinary collaboration framework for zero-shot medical reasoning using role-playing LLM agents (ACL 2024)

Transformer architecture for high-energy physics that treats particle jets as unordered sets of constituent particles, using pairwise particle-particle attention to capture interparticle interactions; achieves state-of-the-art jet tagging on the large-scale JetClass benchmark and is widely adopted in LHC flavor-tagging pipelines (Meta FAIR & Penn State, 135+ stars, MIT License, 2023-2024)

Generative model for programmable protein design using diffusion modeling, equivariant graph neural networks, and conditional random fields to efficiently sample diverse all-atom structures; supports conditional generation via composable conditioners for substructure, symmetry, shape, and neural-network predictions; validated crystallographically (Generate Biomedicines, Nature 2023)

Large-scale PDF/LaTeX/JATS parsing to standardized JSON for millions of papers

Open language model for mathematics (7B/34B) trained on Proof-Pile-2, outperforming Minerva at equal scale on MATH benchmark, with tool use and formal theorem proving in Lean without finetuning (EleutherAI, ICLR 2024)

Huawei's 3D high-resolution global weather forecast model at 0.25° resolution, first AI method to comprehensively outperform traditional NWP across all variables and lead times, integrated into ECMWF operational forecasts (Nature 2023)

3D Equivariant Diffusion for Target-Aware Molecule Generation (ICLR2023)

Single-cell BERT for gene expression

PINN research collection

Secure text-to-visualization through standardized chart specifications

First foundation model for weather and climate by Microsoft, Vision Transformer-based architecture trained on heterogeneous datasets (ICML 2023)

First vision-and-language foundation model for pathology AI, fine-tuned from CLIP on 249K image-caption pairs, enabling open-ended visual-semantic search and zero-shot diagnosis across histopathology (Pathology Foundation, 376+ stars)

Learning nonlinear operators

AI for chemical reaction prediction and synthesis planning

Spherical CNNs for astronomy

Crystal property prediction