quietflamingo/dnabert2-no-flashattention

https://huggingface.co/quietflamingo/dnabert2-no-flashattention
Idleby quietflamingo1.2K2updated 1 year ago

### Note: This model is copied version of DNABERT-2 which removes the FlashAttention integration with Trition. This allows the model to be installed off HuggingFace without having to uninstall Triton. Running the below example code yields identical output compared to the original verison.

Sourced from

  • HuggingFace — quietflamingo/dnabert2-no-flashattention

Related resources

This is the official pre-trained model introduced in DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome .

Idle1.3M1 year ago
Python

# FremyCompany/BioLORD-2023-M This model was trained using BioLORD, a new pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.

Idle37.1K1 year ago
Python
Idle4.1K1 year ago
Python
Idle2.8K1 year ago
Python

# Model Card for Model ID PlantGFM is a genetic foundation model pre-trained on the complete genome sequences of 12 model plants, encompassing 108 billion nucleotides. Using the Hyena framework with 220 million parameters and a context length of 64K bp, PlantGFM models sequences at…

Idle751 year ago
Idle2031 year ago
Python