REFUTE

github.com/connerlambden/refute-inspect
Active2updated 3 months ago
Python
MIT

REFUTE is an open benchmark for scientific critique honesty and epistemic calibration on recent life-science and biomedical literature. It tests whether models keep claims inside what the evidence allows (overclaim / planted-flaw / falsifier selection) and whether stated confidence is calibrated, with judge-free MCQ axes plus open-ended critique scoring.

Sourced from

  • GitHub — github.com/connerlambden/refute-inspect
  • bio.tools — bgpt-refute