seyonec/ChemBERTa-zinc-base-v1
https://huggingface.co/seyonec/ChemBERTa-zinc-base-v1Deep learning for chemistry and materials science remains a novel field with lots of potiential. However, the popularity of transfer learning based methods in areas such as NLP and computer vision have not yet been effectively developed in computational chemistry + machine learning.
Sourced from
- HuggingFace — seyonec/ChemBERTa-zinc-base-v1
Related resources
zhihan1996/DNA_bert_4
by zhihan1996# ChemGPT 4.7M ChemGPT is based on the GPT-Neo model and was introduced in the paper Neural Scaling of Deep Chemical Models.
zhihan1996/DNA_bert_6
by zhihan1996doctolib-lab/doctobert-fr-base
by doctolib-lab🤗 Blog | 📄 Paper | 💻 Code | 🌐 FineMed | 🩺 DoctoBERT
In recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains.
This model is a lightweight model pre-trained on SELFIES (Self-Referencing Embedded Strings) representations of molecules. It is trained on 2.7M unique and valid molecules taken from COCONUTDB and ChemBL34, with 7.3M total generated masked examples.