prithivMLmods/Common-Voice-Gender-Detection

A DNA annotation model from the Carbon family.

GitHub homepage: Cell2Sentence GitHub

A compact protein language model distilled from ProtGPT2 using complementary-regularizer distillation---a method that combines uncertainty-aware position weighting with calibration-aware label smoothing to achieve 31% better perplexity than standard knowledge distillation at 3.8x compression.

!image/png

Matěj Pekár, Vít Musil, Rudolf Nenutil, Petr Holub, Tomáš Brázdil