跳到正文
研踪PaperTrail
← 研踪 PaperTrail

arXiv:2606.08969 · v2

CARE: A Conformal Safety Layer for Medical Summarization

首次提交 2026-06-08 11:10
版本更新 2026-11-15 12:57
雷达观测 2026-11-17 19:15
arXiv ↗PDF ↗

摘要

Large language models (LLMs) are increasingly used for medical summarization but can omit medically important information and introduce unsupported claims. Existing error-detection methods produce heuristic or uncalibrated scores, providing no formal control over missed errors and no principled way to trade off safety against clinician review burden. We introduce Conformal Assessment for Risk Evaluation (CARE), a post-hoc risk-control layer that adds calibrated omission and hallucination annotations without retraining the summarizer. CARE uses scalar conformal risk control (CRC) to bound the probability that a document contains an unflagged hallucinated sentence, and Learn-Then-Test fixed-sequence testing (LTT-FST) to control the expected fraction of true omissions left unsurfaced for review. Omission surfacing depends jointly on sentence importance and summary coverage, a two-dimensional threshold-selection problem; we show that calibrating one gate and then imposing an uncalibrated second gate can invalidate risk control. Across five medical summarization tasks, mean held-out violation over 100 random calibration/test resplits remains at or below the target for both controllers. At α=0.15α=0.15, LTT-FST achieves the lowest review workload on three of five datasets among omission baselines held to the same confidence guarantee. Review workload varies by task and is highest for long, high-compression documents. On 46 clinician-annotated documents, the calibrated hallucination controller flags 88% of clinician-identified hallucinated sentences. In a preliminary study of 75 clinician reviews, assisted review-time omission coverage increased from 50.4% to 79.0% without increasing review time. Overall, CARE provides a principled framework for targeted, risk-controlled review of LLM-generated medical summaries.

作者备注:36 pages, 3 figures, 35 tables. Machine Learning for Health (ML4H) 2026

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

本站首次收录为 v2,暂无更早版本可对照。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v2 · 2026-11-15 12:57 · 最新观测版本

CARE: A Conformal Safety Layer for Medical Summarization

Large language models (LLMs) are increasingly used for medical summarization but can omit medically important information and introduce unsupported claims. Existing error-detection methods produce heuristic or uncalibrated scores, providing no formal control over missed errors and no principled way to trade off safety against clinician review burden. We introduce Conformal Assessment for Risk Evaluation (CARE), a post-hoc risk-control layer that adds calibrated omission and hallucination annotations without retraining the summarizer. CARE uses scalar conformal risk control (CRC) to bound the probability that a document contains an unflagged hallucinated sentence, and Learn-Then-Test fixed-sequence testing (LTT-FST) to control the expected fraction of true omissions left unsurfaced for review. Omission surfacing depends jointly on sentence importance and summary coverage, a two-dimensional threshold-selection problem; we show that calibrating one gate and then imposing an uncalibrated second gate can invalidate risk control. Across five medical summarization tasks, mean held-out violation over 100 random calibration/test resplits remains at or below the target for both controllers. At α=0.15α=0.15, LTT-FST achieves the lowest review workload on three of five datasets among omission baselines held to the same confidence guarantee. Review workload varies by task and is highest for long, high-compression documents. On 46 clinician-annotated documents, the calibrated hallucination controller flags 88% of clinician-identified hallucinated sentences. In a preliminary study of 75 clinician reviews, assisted review-time omission coverage increased from 50.4% to 79.0% without increasing review time. Overall, CARE provides a principled framework for targeted, risk-controlled review of LLM-generated medical summaries.

查看此版本解读 →查看此版本原文 ↗