内化投资授权:面向投资组合配置的神经符号强化学习方法
Internalizing Investment Mandates: A Neurosymbolic RL Approach to Portfolio Allocation
Zeynep Yıldız, Satchit Chatterji, Ercan Atam, Erman Acar
AI 速读 基于摘要
提出一种受PLPG启发的连续动作神经符号强化学习方法,通过可微符号监督让智能体在训练中内化制度化的投资授权约束,而非在推理时事后拦截动作。
cs.LG
查看原文摘要
Institutional portfolios operate under investment policy statements that specify asset allocation constraints, often conditioned on market regime information. Deep reinforcement learning has been shown to optimize financial performance but typically does not enforce rule compliance, making it unsuitable for real-world deployment. Existing neurosymbolic methods such as Probabilistic Logic Policy Gradient (PLPG) offer constraint-satisfying reinforcement learning (RL) via differentiable symbolic supervision but assume a finite, discrete action space. We present a PLPG-inspired continuous allocation method that estimates the probability that the policy's own executed action satisfies the investment mandate, using reparameterized Monte Carlo sampling, and adds it to the training objective. No post-hoc enforcement mechanism intercepts actions at inference time and compliance is learned by the agent. Audited directly on deterministic mean actions with no correction, the policy reduces violations of a six-rule regime-conditional mandate from 96-98% for unconstrained RL and 33.4% for a reward-penalty baseline to 4.8%, showing that a continuous-action neurosymbolic policy can substantially internalize a symbolic mandate.