zhangtaolab/plant-dnabert-6mer

https://huggingface.co/zhangtaolab/plant-dnabert-6mer
Idleby zhangtaolab41updated 1 year ago

The plant DNA large language models (LLMs) contain a series of foundation models based on different model architectures, which are pre-trained on various plant reference genomes. All the models have a comparable model size between 90 MB and 150 MB, BPE tokenizer is used for tokenization and 8000…

Sourced from

  • HuggingFace — zhangtaolab/plant-dnabert-6mer

Related resources

The Nucleotide Transformers are a collection of foundational language models that were pre-trained on DNA sequences from whole-genomes. Compared to other approaches, our models do not only integrate information from single reference genomes, but leverage DNA sequences from over 3,200 diverse human…

Idle17.9K1 year ago
Python

The Nucleotide Transformers are a collection of foundational language models that were pre-trained on DNA sequences from whole-genomes. Compared to other approaches, our models do not only integrate information from single reference genomes, but leverage DNA sequences from over 3,200 diverse human…

Idle14.1K11 months ago
Python
Active03 months ago

# ModernGENA base ModernGENA is a DNA foundation model based on ModernBERT (a modernized BERT-style encoder architecture) adapted for genomic sequence modeling. ModernGENA base is the 377M-parameter version introduced in the paper Back to BERT in 2026: ModernGENA as a Strong, Efficient Baseline for…

Active4285 months ago
Idle2.7K1 year ago
Python

A DNA annotation model from the Carbon family.

Active291 day ago
Python