arXiv:2610.34614 · v1

A Battery for AI Propensity Measurement: Rubrics, Synthetic Item Banks, and Annotations

首次提交 2026-10-26 06:22

版本更新 2026-10-26 06:22

雷达观测 2026-10-29 00:36

摘要

We release a battery of 28 propensities for AI research, with expert-written rubrics, synthetic datasets, and annotated demand intervals, built with the method of Romero-Alvarado et al. (2026). We selected a wide collection of generic propensities that may influence the behavior of AI systems and humans. They are inspired by psychometric, psychological, and behavioral research, so that experimental results can be understood in the context of familiar constructs previously used also for human behavior research. The rubrics are useful for annotating existing benchmarks whose items may be relevant or not for one or more propensities. For easier profiling, however, the synthetic datasets are defined in such a way that they should be sensitive to one propensity only, allowing for a quick prototyping of propensity profiles using the battery of datasets. We also outline directions for future propensity research.

作者备注：10 pages, 2 figures, instrument release