medicalai/ClinicalBERT
https://huggingface.co/medicalai/ClinicalBERTThis model card describes the ClinicalBERT model, which was trained on a large multicenter dataset with a large corpus of 1.2B words of diverse diseases we constructed. We then utilized a large-scale corpus of EHRs from over 3 million patient records to fine tune the base language model.
Sourced from
- HuggingFace — medicalai/ClinicalBERT
Related resources
zhihan1996/DNA_bert_5
by zhihan1996zhihan1996/DNA_bert_4
by zhihan1996Deep learning for chemistry and materials science remains a novel field with lots of potiential. However, the popularity of transfer learning based methods in areas such as NLP and computer vision have not yet been effectively developed in computational chemistry + machine learning.
zhihan1996/DNA_bert_6
by zhihan1996This is a Japanese RoBERTa base model pre-trained on academic articles in medical sciences collected by Japan Science and Technology Agency (JST).
In recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains.