HarshBhanushali7705/medgemma-27b-text-it-GPTQ-4bit

https://huggingface.co/HarshBhanushali7705/medgemma-27b-text-it-GPTQ-4bit
Activeby HarshBhanushali77053463updated 1 week ago

This repository contains a 4-bit GPTQ quantized version of google/medgemma-27b-text-it, optimized for high-throughput inference using vLLM and the Marlin kernel.

Sourced from

  • HuggingFaceHarshBhanushali7705/medgemma-27b-text-it-GPTQ-4bit

Related resources

Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.

Idle5011 year ago
Python

GRamma-12B is a 12-billion-parameter instruction-tuned language model specialized for the Greek medical domain. It is built on top of Gemma 3 12B Instruct and adapted through parameter-efficient fine-tuning on a collection of Greek and bilingual medical question-answering data.

Active193 weeks ago
Python

Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.

Idle9.4K1 year ago
Python
Stale3312 years ago
Python

Details coming soon

Stale2912 years ago
Python