Find open-source science resources

Phylogeny-aware genomic language model trained on whole-genome alignments across multiple evolutionary timescales, predicting functional constraints and variant effects for human, mouse, chicken, fly, worm, and Arabidopsis genomes (344+ stars, MIT License)

Transformer foundation model for tandem mass spectrometry (MS/MS) self-supervised on millions of unannotated spectra from the GeMS dataset via masked peak prediction and chromatographic retention-order objectives, producing 1024-dimensional molecular representations; achieves SOTA on spectral similarity, chemical property, and molecular fingerprint prediction, and powers the DreaMS Atlas annotating 201M+ MS/MS spectra for metabolomics and natural product discovery (Pluskal Lab, IOCB Prague & MIT, 211+ stars, MIT License)

Single-cell analysis with transformers

Generative AI framework for inverse design of 3D RNA structure and function using geometric deep learning, learning design rules from 3D structures to capture complex tertiary interactions (pseudoknots, non-canonical base pairs) with expert-level accuracy for designing functional RNAs including aptamers and ribozymes (bioRxiv 2025)

Family of generative single-cell foundation models (TF-Metazoa, TF-Exemplar, TF-Sapiens) jointly modeling genes and their expression levels via expression-aware autoregressive transformers, trained on up to 112M cells across 12 species spanning 1.53 billion years of evolution; achieves robust zero-shot cell type classification across species, disease state identification in human cells, and prediction of cell-type-specific transcription factors and gene-gene regulatory relationships, pip-installable with pretrained weights (CZI, 166+ stars, MIT License)

RNA foundation model trained on millions of RNA sequences for generalist RNA sequence understanding, enabling downstream structure prediction, function annotation, and representation learning for non-coding RNAs (ml4bio, 372+ stars)