RaphaelMourad/Mistral-DNA-v1-138M-bacteria

https://huggingface.co/RaphaelMourad/Mistral-DNA-v1-138M-bacteria
Staleby RaphaelMourad164updated 2 years ago
Python

The Mistral-DNA-v1-138M-bacteria Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters. It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.

Sourced from

  • HuggingFace — RaphaelMourad/Mistral-DNA-v1-138M-bacteria

Related resources

Evo2-1B-Base (Transformers port)

Active1.7K3 weeks ago
Python
Active51 week ago
Python

This 1,120,772,224-parameter nucleotide-level causal language model is a member of the eight-model MarinDNA v0.5 parameter-scaling ladder developed with Marin. This repository contains only the final step-215573 checkpoint from run dna-bolinas-scaling-v0.5-h1920-p1B-0dc6f4, with its tokenizer…

Active2132 months ago
Python

The plant DNA large language models (LLMs) contain a series of foundation models based on different model architectures, which are pre-trained on various plant reference genomes. All the models have a comparable model size between 90 MB and 150 MB, BPE tokenizer is used for tokenization and 8000…

Idle3171 year ago
Python

!image/png

Stale1152 years ago
Python

ProtGPT3-10B is a single-sequence autoregressive protein language model for protein sequence generation. It is the largest model in the ProtGPT3 family, an open-source suite of promptable and aligned protein language models ranging from 112M to 10B parameters.

Active994 months ago
Python