plant-llms/PlantBiMoE
https://huggingface.co/plant-llms/PlantBiMoEIdleby plant-llms102updated 6 months ago
## Model Overview PlantBiMoE is a DNA language model trained on 42 representative plant species genomes. More specifically, PlantBiMoE uses the BiMamba and SparseMoE architecture with a masked language modeling objective to leverage highly available genotype data from 42 different plant speices to…
Sourced from
- HuggingFace — plant-llms/PlantBiMoE
Related resources
zhihan1996/DNA_bert_3
by zhihan1996zhihan1996/DNA_bert_4
by zhihan1996zhihan1996/DNA_bert_6
by zhihan1996zhihan1996/DNA_bert_5
by zhihan1996DOEJGI/GenomeOcean-4B
by DOEJGIThis is the base model of GenomeOcean-4B. It is trained with Causal Language Modeling (CLM) and uses a BPE tokenizer with 4096 tokens. It supports a maximum sequence length of 10240 tokens (~50kbp).
Idle1.9K1 year ago