← 研踪 PaperTrailarXiv:2611.01345 · v1
Unified dynamics of training, learning, inference, and reinforcement in neural networks
首次提交 2026-11-01 07:21
版本更新 2026-11-01 07:21
雷达观测 2026-11-04 23:43
摘要
Despite their remarkable success, neural networks remain largely black boxes, and the mechanisms underlying their behavior are still poorly understood. Nine nanoGPT experiments established training-learning-inference relations: realized updates elicit state-dependent finite-amplitude responses; learning persistently reorganizes distributed functional support, with target-specific readout-boundary crossings determining capability transitions; inference recruits learned support without changing the learned state. Factors identified in the fifth experiment yielded a direct predictor of post-update capability transitions, achieving 91.43% accuracy and 91.49% four-way macro recall across 5,088 targets. We tested these relations and prediction across five additional neural architectures. In a seventh system, concentrated correct feedback eroded previously mastered skills; rebalanced feedback restored their accuracy from 70.31% to 99.48%. Linking inference consequences to subsequent training closes these relations into unified training-learning-inference-reinforcement dynamics.
作者备注：23 pages, 3 figures, 3 tables
观测到的版本
相邻记录可能跳过中间版本；首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-01 07:21 · 最新观测版本
Unified dynamics of training, learning, inference, and reinforcement in neural networks
Despite their remarkable success, neural networks remain largely black boxes, and the mechanisms underlying their behavior are still poorly understood. Nine nanoGPT experiments established training-learning-inference relations: realized updates elicit state-dependent finite-amplitude responses; learning persistently reorganizes distributed functional support, with target-specific readout-boundary crossings determining capability transitions; inference recruits learned support without changing the learned state. Factors identified in the fifth experiment yielded a direct predictor of post-update capability transitions, achieving 91.43% accuracy and 91.49% four-way macro recall across 5,088 targets. We tested these relations and prediction across five additional neural architectures. In a seventh system, concentrated correct feedback eroded previously mastered skills; rebalanced feedback restored their accuracy from 70.31% to 99.48%. Linking inference consequences to subsequent training closes these relations into unified training-learning-inference-reinforcement dynamics.
查看此版本解读 →查看此版本原文 ↗