arXiv:2611.18297 · v1
When evaluation becomes intervention in clinical AI
摘要
AI judges, models that grade another system's output against a rubric, extend clinical review to the scale at which clinical AI writes. When teams use judge assessments to select a prompt or train a model, the judge becomes part of the intervention. Selection can then favor errors the judge overlooks. We describe what a judge's report must contain and the independent clinical test each judge-driven change needs.
作者备注:12 pages, 3 figures, 1 box. Submitted to npj Digital Medicine