quietflamingo/dnabert2-no-flashattention

https://huggingface.co/quietflamingo/dnabert2-no-flashattention
Idleby quietflamingo1.2K2updated 1 year ago

### Note: This model is copied version of DNABERT-2 which removes the FlashAttention integration with Trition. This allows the model to be installed off HuggingFace without having to uninstall Triton. Running the below example code yields identical output compared to the original verison.

Sourced from

  • HuggingFacequietflamingo/dnabert2-no-flashattention

Related resources

This is the official pre-trained model introduced in DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome .

Idle535.6K1 year ago
Python

# FremyCompany/BioLORD-2023-M This model was trained using BioLORD, a new pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.

Idle37.9K1 year ago
Python
Idle24K1 year ago
Python
Idle8.1K1 year ago
Python

# Model Card for Model ID PlantGFM is a genetic foundation model pre-trained on the complete genome sequences of 12 model plants, encompassing 108 billion nucleotides. Using the Hyena framework with 220 million parameters and a context length of 64K bp, PlantGFM models sequences at…

Idle7511 months ago
Idle2311 year ago
Python