Manhph2211/D-BETA

In recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains.

> [!IMPORTANT] > 🎉 Check out the latest version of Phikon here: Phikon-v2 > > Phikon is a self-supervised learning model for histopathology trained with iBOT.

🤗 Blog | 📄 Paper | 💻 Code | 🌐 FineMed | 🩺 DoctoBERT

This model is a fine-tuned model based on the Llama 2_7b architecture. It has been specifically trained on a dataset comprising USMLE (United States Medical Licensing Examination) questions and answers, as well as conversations between doctors and patients.