← 研踪 PaperTrailarXiv:2611.17286 · v1
Fictitious Play When Agents Are Not Expected-Utility Maximizers: A Geometric Analysis in $2$-Action Games
当智能体不是期望效用最大化者时的虚拟博弈:双动作博弈中的几何分析
首次提交 2026-11-13 02:52
版本更新 2026-11-13 02:52
雷达观测 2026-11-13 14:15
摘要
Fictitious play (FP) is one of the earliest and most fundamental learning procedures in games, where each agent independently chooses a best response to the empirical distribution of opponents' past actions by maximizing the expected payoff with respect to it. However, learning agents may not always be expected-utility maximizers: they may use nonlinear evaluation functionals to account for the uncertainty induced by the opponents, e.g., via risk measures. In this work, we study nonlinear fictitious play (NL-FP), in which each pure action is evaluated by a general, possibly nonlinear functional of the payoff distribution induced by the opponent's empirical belief. To analyze NL-FP, we first identify a single-crossing property (SCP) of evaluation functionals that preserves the classical geometry of FP in games. Furthermore, we conduct a novel geometric analysis of the convergence behavior of NL-FP in games, even when the SCP fails. Beyond games, we show that the convergence of NL-FP in () games may fail even for continuous-time NL-FP, when the two-action player uses conditional value-at-risk (CVaR) in a game. In addition, we identify a finite-crossing condition that ensures convergence of the selected continuous-time dynamics and the discrete-time iterates in general games, which also provides new insights into the global landscape of continuous-time classical FP in such games.
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-13 02:52 · 最新观测版本
Fictitious Play When Agents Are Not Expected-Utility Maximizers: A Geometric Analysis in $2$-Action Games
Fictitious play (FP) is one of the earliest and most fundamental learning procedures in games, where each agent independently chooses a best response to the empirical distribution of opponents' past actions by maximizing the expected payoff with respect to it. However, learning agents may not always be expected-utility maximizers: they may use nonlinear evaluation functionals to account for the uncertainty induced by the opponents, e.g., via risk measures. In this work, we study nonlinear fictitious play (NL-FP), in which each pure action is evaluated by a general, possibly nonlinear functional of the payoff distribution induced by the opponent's empirical belief. To analyze NL-FP, we first identify a single-crossing property (SCP) of evaluation functionals that preserves the classical geometry of FP in games. Furthermore, we conduct a novel geometric analysis of the convergence behavior of NL-FP in games, even when the SCP fails. Beyond games, we show that the convergence of NL-FP in () games may fail even for continuous-time NL-FP, when the two-action player uses conditional value-at-risk (CVaR) in a game. In addition, we identify a finite-crossing condition that ensures convergence of the selected continuous-time dynamics and the discrete-time iterates in general games, which also provides new insights into the global landscape of continuous-time classical FP in such games.
查看此版本解读 →查看此版本原文 ↗