AIRI-Institute/moderngena-base
https://huggingface.co/AIRI-Institute/moderngena-base# ModernGENA base ModernGENA is a DNA foundation model based on ModernBERT (a modernized BERT-style encoder architecture) adapted for genomic sequence modeling. ModernGENA base is the 377M-parameter version introduced in the paper Back to BERT in 2026: ModernGENA as a Strong, Efficient Baseline for…
Sourced from
- HuggingFace — AIRI-Institute/moderngena-base
Related resources
Taykhoom/ModernGENA-large
by TaykhoomMinimal HuggingFace repackage of the large variant of ModernGENA -- a ModernBERT DNA encoder pretrained on vertebrate genomes with masked language modeling.
zhangtaolab/plant-dnabert-6mer
by zhangtaolabThe plant DNA large language models (LLMs) contain a series of foundation models based on different model architectures, which are pre-trained on various plant reference genomes. All the models have a comparable model size between 90 MB and 150 MB, BPE tokenizer is used for tokenization and 8000…
InstaDeepAI/NTv3_100M_pre
by InstaDeepAIdarlednik/LDARNet-110M
by darlednikPretrained LDARNet (~110M params) with learnable DNA tokenization (dynamic chunking + BiMamba-2).
darlednik/LDARNet-2M
by darlednikPretrained LDARNet (~2M params) with learnable DNA tokenization (dynamic chunking + BiMamba-2).
paradoxdan/nano-scGPT
by paradoxdan# nano-scGPT The simplest, fastest repository for scGPT inference, (soon) finetuning and trianing, with minimal dependencies. It reimplements the original scGPT from scratch. nanoscgpt/model.py is pure PyTorch in ~270 lines of code, and nanoscgpt/scGPT_tokenizer.py turns raw scRNA data into model…