← 研踪 PaperTrailarXiv:2605.18738 · v2
Do Language Models Share Your Doctor's Priorities? Measuring Values from Clinical Decisions
首次提交 2026-05-19 01:56
版本更新 2026-11-10 01:04
雷达观测 2026-11-10 15:22
摘要
Clinical decisions often require weighing autonomy, beneficence, nonmaleficence, and justice. Reasonable physicians may prioritize these values differently, yet the values that language models bring to medical advice remain poorly characterized. We introduce ValuePrism, an instrument for measuring value priorities from clinical decisions. ValuePrism combines a benchmark of 50 clinical dilemmas, each reviewed by two physicians, with an attribution method that estimates relative value priorities from choices between medically reasonable recommendations. Each case presents a clinical vignette and two mutually exclusive recommendations designed so that choosing one necessarily promotes certain values at the expense of others. Applying the instrument to frontier language models and a US-based physician panel, we find that models frequently acknowledge values favoring both recommendations but make highly consistent decisions across repeated queries, even on cases that sharply divide physicians. The ValuePrism attribution method shows that both physicians and language models express differentiated value priorities. Collectively, model values exhibit substantial diversity and most tend to fall within the physician-panel reference range. Nevertheless, a single model deployed unchecked would amplify its particular values to patients at scale. ValuePrism provides a common basis for measuring and comparing the clinical value priorities expressed by language models and physicians. Data and code are available at https://github.com/payalchandak/value-prism.
作者备注：Data and code are available at https://github.com/payalchandak/value-prism
观测到的版本
相邻记录可能跳过中间版本；首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-10 01:04 · 最新观测版本
Do Language Models Share Your Doctor's Priorities? Measuring Values from Clinical Decisions
Clinical decisions often require weighing autonomy, beneficence, nonmaleficence, and justice. Reasonable physicians may prioritize these values differently, yet the values that language models bring to medical advice remain poorly characterized. We introduce ValuePrism, an instrument for measuring value priorities from clinical decisions. ValuePrism combines a benchmark of 50 clinical dilemmas, each reviewed by two physicians, with an attribution method that estimates relative value priorities from choices between medically reasonable recommendations. Each case presents a clinical vignette and two mutually exclusive recommendations designed so that choosing one necessarily promotes certain values at the expense of others. Applying the instrument to frontier language models and a US-based physician panel, we find that models frequently acknowledge values favoring both recommendations but make highly consistent decisions across repeated queries, even on cases that sharply divide physicians. The ValuePrism attribution method shows that both physicians and language models express differentiated value priorities. Collectively, model values exhibit substantial diversity and most tend to fall within the physician-panel reference range. Nevertheless, a single model deployed unchecked would amplify its particular values to patients at scale. ValuePrism provides a common basis for measuring and comparing the clinical value priorities expressed by language models and physicians. Data and code are available at https://github.com/payalchandak/value-prism.
查看此版本解读 →查看此版本原文 ↗