跳到正文
研踪PaperTrail
← 研踪 PaperTrail

arXiv:2611.21509 · v1

Almost Controlled: The FDR of Benjamini-Hochberg on Weighted Conformal p-Values

几乎受控:加权保形p值上Benjamini-Hochberg方法的FDR

首次提交 2026-11-17 02:07
版本更新 2026-11-17 02:07
雷达观测 2026-11-17 16:10
arXiv ↗PDF ↗

摘要

Weighted conformal p-values generalize conformal inference to cases with covariate shift. One way to use them is to pass them to the Benjamini-Hochberg (BH) procedure, either to decide which test units to select or to detect outliers. But weighted conformal p-values may not be positively dependent, so we want to know: does BH still control the false discovery rate (FDR) in finite samples? Based on experiments, it appears to, but we prove it doesn't. We give two counterexamples, certified in exact rational arithmetic, where the FDR exceeds its target level qq. We also identify how large the difference between the FDR and qq can be. With nn calibration points, mm test units and weight ratio BB, the relative excess FDR/q−1\mathrm{FDR}/q-1 is bounded by a function of nn, mm, BB and qq that is of order Bm/(nq)\sqrt{Bm/(nq)} when Bm/(nq)Bm/(nq) is small. The bound holds for every configuration with B≤nB\le n and every nn. This order can be reached when multiple non-null test units share a common threshold: in a Poisson-limit model, that configuration's excess is c(q)Bm/(nq)c(q)\sqrt{Bm/(nq)} to first order as B/n→0B/n\to0 and then m→∞m\to\infty. For some fixed distributions with this structure, the excess decreases only like n−1/2n^{-1/2} as nn grows. If every test unit is null, the excess is O(B/n)O(B/n) at fixed mm, and in certain configurations it grows linearly with mm. To assist practitioners in judging how large the FDR can be, we turn that bound, which depends only on nn, mm, qq and BB, into a lowered BH level with proved finite-sample control, and give a much less conservative rule of thumb that covers every worst case we were able to find but provides no guarantee.

作者备注:55 pages, 3 figures, 1 table. Main text 10 pages; full proofs in the appendices

AI 论文解读

基于摘要 · 非全文审阅

作者证明加权保形p值下BH的FDR在有限样本中可能超过目标水平,并给出超额上界与实用调整规则。

正在读取账号与研究记录…

版本差异

目前只收录了一个版本。收录下一版后,可以对照标题、作者、分类和摘要。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v1 · 2026-11-17 02:07 · 最新观测版本

Almost Controlled: The FDR of Benjamini-Hochberg on Weighted Conformal p-Values

Weighted conformal p-values generalize conformal inference to cases with covariate shift. One way to use them is to pass them to the Benjamini-Hochberg (BH) procedure, either to decide which test units to select or to detect outliers. But weighted conformal p-values may not be positively dependent, so we want to know: does BH still control the false discovery rate (FDR) in finite samples? Based on experiments, it appears to, but we prove it doesn't. We give two counterexamples, certified in exact rational arithmetic, where the FDR exceeds its target level qq. We also identify how large the difference between the FDR and qq can be. With nn calibration points, mm test units and weight ratio BB, the relative excess FDR/q−1\mathrm{FDR}/q-1 is bounded by a function of nn, mm, BB and qq that is of order Bm/(nq)\sqrt{Bm/(nq)} when Bm/(nq)Bm/(nq) is small. The bound holds for every configuration with B≤nB\le n and every nn. This order can be reached when multiple non-null test units share a common threshold: in a Poisson-limit model, that configuration's excess is c(q)Bm/(nq)c(q)\sqrt{Bm/(nq)} to first order as B/n→0B/n\to0 and then m→∞m\to\infty. For some fixed distributions with this structure, the excess decreases only like n−1/2n^{-1/2} as nn grows. If every test unit is null, the excess is O(B/n)O(B/n) at fixed mm, and in certain configurations it grows linearly with mm. To assist practitioners in judging how large the FDR can be, we turn that bound, which depends only on nn, mm, qq and BB, into a lowered BH level with proved finite-sample control, and give a much less conservative rule of thumb that covers every worst case we were able to find but provides no guarantee.

查看此版本解读 →查看此版本原文 ↗