elonlit/GeneJEPA

https://huggingface.co/elonlit/GeneJEPA
Idleby elonlit07updated 11 months ago

GeneJEPA is a Joint-Embedding Predictive Architecture (JEPA) trained for self-supervised representation learning on scRNA-seq. It uses a Perceiver-style encoder to handle sparse, high-dimensional gene count vectors and a Fourier-feature tokenizer for numerical tokenization.

Sourced from

  • HuggingFaceelonlit/GeneJEPA

Related resources

scRep is a PyTorch model for extracting cell embeddings from single-cell RNA-seq AnnData (.h5ad) inputs. This repository is a standalone Hugging Face release bundle: it includes checkpoint weights, the exact paired gene vocabulary, the inference implementation, and runnable examples.

Active01 week ago

An extended version of SCimilarity, a metric-learning model for single-cell RNA-seq that maps cells to a unified 128-dimensional embedding space. The original model and method are described in:

Active04 months ago

# FremyCompany/BioLORD-2023-M This model was trained using BioLORD, a new pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.

Idle37.1K1 year ago
Python
Idle3.7K1 year ago
Python

Universal Cell Embeddings (UCE) is a foundation model designed for single-cell RNA sequencing data analysis. UCE generates a universal representation of cells that captures the molecular diversity across different cell types, tissues, and species.

Stale142 years ago

A diffusion language model for genome-scale perturbation prediction across diverse cellular contexts.

Idle06 months ago