plant-llms/PlantBiMoE

https://huggingface.co/plant-llms/PlantBiMoE
Idleby plant-llms102updated 6 months ago

## Model Overview PlantBiMoE is a DNA language model trained on 42 representative plant species genomes. More specifically, PlantBiMoE uses the BiMamba and SparseMoE architecture with a masked language modeling objective to leverage highly available genotype data from 42 different plant speices to…

Sourced from

  • HuggingFaceplant-llms/PlantBiMoE

Related resources

Idle1.2K11 months ago
Python
Idle9811 months ago
Python
Idle3.8K11 months ago
Python
Idle9111 months ago
Python

This is the base model of GenomeOcean-4B. It is trained with Causal Language Modeling (CLM) and uses a BPE tokenizer with 4096 tokens. It supports a maximum sequence length of 10240 tokens (~50kbp).

Idle1.9K1 year ago