← 研踪 PaperTrailarXiv:2604.03614 · v5
One-Shot Localisation of the Global Minimum of a Noisy One-Dimensional Function: A Controlled Comparison of an Iterative Neural Minimizer, Set Transformers and Classical Estimators
首次提交 2026-04-04 15:02
版本更新 2026-10-27 14:40
雷达观测 2026-10-29 00:35
摘要
We study passive global optimisation: from twenty noisy samples of an unknown one-dimensional function, with no further queries, estimate where its global minimum lies. We build a benchmark and a self-checking harness and use them for a controlled comparison. The Neural Function Minimizer (NFM), which we introduce, moves a position across the domain for fifteen steps and re-reads the samples from it at every step; a same-size Set Transformer answers in one pass. In a 2x2 design each has one output head or an added mixture head, with the same data and inputs and three seeds each. Within the training families the two are tied on location error, and the mixture loss lowers it by about 0.45 points of the domain in both. The NFM's answers have lower regret, by 2.90 and 3.12 points of the range with one and two heads (significant after correction, and again on a block of fresh cases), mainly because its right-basin answers lie closer to the floor; a Set Transformer looped to the NFM's computation does not reproduce this within the training families, though it has the lower error on unseen functions (exploratory). The NFM also differs from the Set Transformers in encoder, local read, activation, losses and training time. At near-tied minima the form of the answer decides: point answers hedge in about a quarter of exact ties, mixture modes almost never, mixture means in more than 80%. Gaussian-process estimators, with no training, have the lowest regret and are the most accurate on unseen functions. We will release the benchmark, the models and the harness.
作者备注：49 pages, 5 figures, 15 tables. Code, models and results will be released
观测到的版本
相邻记录可能跳过中间版本；首次发现 v2 及以上也会标为版本更新。
v5 · 2026-10-27 14:40 · 最新观测版本
One-Shot Localisation of the Global Minimum of a Noisy One-Dimensional Function: A Controlled Comparison of an Iterative Neural Minimizer, Set Transformers and Classical Estimators
We study passive global optimisation: from twenty noisy samples of an unknown one-dimensional function, with no further queries, estimate where its global minimum lies. We build a benchmark and a self-checking harness and use them for a controlled comparison. The Neural Function Minimizer (NFM), which we introduce, moves a position across the domain for fifteen steps and re-reads the samples from it at every step; a same-size Set Transformer answers in one pass. In a 2x2 design each has one output head or an added mixture head, with the same data and inputs and three seeds each. Within the training families the two are tied on location error, and the mixture loss lowers it by about 0.45 points of the domain in both. The NFM's answers have lower regret, by 2.90 and 3.12 points of the range with one and two heads (significant after correction, and again on a block of fresh cases), mainly because its right-basin answers lie closer to the floor; a Set Transformer looped to the NFM's computation does not reproduce this within the training families, though it has the lower error on unseen functions (exploratory). The NFM also differs from the Set Transformers in encoder, local read, activation, losses and training time. At near-tied minima the form of the answer decides: point answers hedge in about a quarter of exact ties, mixture modes almost never, mixture means in more than 80%. Gaussian-process estimators, with no training, have the lowest regret and are the most accurate on unseen functions. We will release the benchmark, the models and the harness.
查看此版本解读 →查看此版本原文 ↗