谁的护栏?用户身份塑造模型免责声明在缓解大语言模型政治说服中的有效性
Whose Guardrail? User Identity Shapes the Effectiveness of Model Disclaimers in Mitigating LLM Political Persuasion
Jillian Fisher, Thomas Richardson, Daniel W. Fisher, Jennifer Pan, Yulia Tsvetkov, Katharina Reinecke
AI 速览:一项预注册实验(N=1,586)发现,标明政治偏见并附解释的免责声明可短期减少说服,但效果因情境而异且不持久,用户身份与AI使用特征才是更稳定的预测因素。
Politically biased AI can shift users' opinions, yet it remains unclear whether model disclaimers protect against such persuasion. We report a preregistered experiment (N=1,586) examining how disclaimer design and user characteristics shape susceptibility to politically biased AI. We varied whether disclaimers identified political bias versus potential inaccuracies and whether they included an explanation. Participants completed two decision-making tasks with an LLM biased against their political views, with outcomes assessed immediately and one week later. Disclaimers identifying political bias and including an explanation reduced persuasion, but effects varied across contexts and did not persist. Individual differences were more consistent predictors: Republicans were more persuaded and reported higher trust than Democrats across tasks. Similarly, participants who used AI more frequently were also more persuaded, whereas those with greater self-reported AI knowledge were less persuaded. These findings suggest that generic disclaimers are not enough: effective safeguards must account for user heterogeneity and context.