← 研踪 PaperTrailarXiv:2611.12339 · v1
Evidence or Marginal? What Moment-Vector Propagation Computes in Polynomial Density Neurons
首次提交 2026-11-09 20:57
版本更新 2026-11-09 20:57
雷达观测 2026-11-10 15:22
摘要
When a neuron's input is lost, or known through a belief , what should it output? For a neuron storing a joint polynomial density with input density , two formulas compete. costs one matrix-vector product; Hierarchical Correlation Reconstruction introduces it as a constant-denominator approximation to . For a density model both are exact answers to different questions: is Bayesian updating with the belief as virtual evidence; installs the belief as a new marginal (Jeffrey's rule). With a missing input returns the model's conditional; generally does not. This post hoc reading is proved, and illustrated outside the pair family up to inputs; it has no pre-registered test, only one exploratory real-data pilot. Post hoc, closed forms fall within a factor 2 of all 112 measured gaps, and negative density begins near input correlation . In a pre-registered synthetic study (up to 32 inputs), 5 of 15 hypotheses are supported, 2 inconclusive and 8 not supported, including all three on transfer beyond equicorrelated Gaussians. Post hoc, where is defined, truncation usually outweighs the gap for Beta beliefs in pair neurons; triple neurons under flat and data beliefs are exceptions.
作者备注:33 pages, 12 figures, 33 tables. Code: https://github.com/Przemyslaw11/EvidenceOrMarginal
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-09 20:57 · 最新观测版本
Evidence or Marginal? What Moment-Vector Propagation Computes in Polynomial Density Neurons
When a neuron's input is lost, or known through a belief , what should it output? For a neuron storing a joint polynomial density with input density , two formulas compete. costs one matrix-vector product; Hierarchical Correlation Reconstruction introduces it as a constant-denominator approximation to . For a density model both are exact answers to different questions: is Bayesian updating with the belief as virtual evidence; installs the belief as a new marginal (Jeffrey's rule). With a missing input returns the model's conditional; generally does not. This post hoc reading is proved, and illustrated outside the pair family up to inputs; it has no pre-registered test, only one exploratory real-data pilot. Post hoc, closed forms fall within a factor 2 of all 112 measured gaps, and negative density begins near input correlation . In a pre-registered synthetic study (up to 32 inputs), 5 of 15 hypotheses are supported, 2 inconclusive and 8 not supported, including all three on transfer beyond equicorrelated Gaussians. Post hoc, where is defined, truncation usually outweighs the gap for Beta beliefs in pair neurons; triple neurons under flat and data beliefs are exceptions.
查看此版本解读 →查看此版本原文 ↗