AI风险行为的基准测试
Benchmarking AI risk behaviors
Luhan Mikaelson, Robert Adragna, Emmett Brosowsky, Hayley Clatterbuck
AI 速读 基于摘要
作者提出一套评估工具,用来刻画大语言模型在不同情境与任务需求下的风险偏好、行为稳定性与一致性,并比较不同代际和模型家族之间的变化趋势。
cs.AI · cs.LG
查看原文摘要
We evaluate LLM risk propensities across a range of contexts and task demands. We evaluate models for how risk averse or risk tolerant they are in various conditions, as well as how stable and consistent their behavior is across conditions. We present a toolkit for developing model risk profiles that can be used to predict model behavior and which can be adapted to include new evaluations of risk propensities. We also examine how these properties have changed across model generations and families. We observe that 2026 state-of-the-art models tend to be more stable, more consistent, and more risk neutral than older models. These trends appear to be related; newer models are more stable and consistent because they are more likely to use expected value maximization as a decision procedure.