mradermacher/Medichat-V2-Llama3-8B-GGUF

From Inquiry to Decision: Building Trustworthy Medical AI

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

This project fine-tunes the meta-llama/Llama-4-Scout-17B-16E-Instruct model using a medical reasoning dataset (FreedomIntelligence/medical-o1-reasoning-SFT) with 4-bit quantization for memory-efficient training.

Using llama.cpp release b4404 for quantization.