Loss-Controlling Calibration with Asymptotic Guarantees
Di Wang, Yujin Li, Junzhi Shi, Pingping Wang, Shuo Zhuang, Hongyue Li
原文摘要
We propose a learning framework for calibrating predictive models to perform loss-controlling prediction, which extends our proposed conformal loss-controlling prediction framework to more general settings. In contrast to existing methods, the predictors built by the proposed approach are not restricted to set-valued predictors, and the loss function can be any measurable function without requiring monotonicity assumptions. The approach is a natural extension of conformal loss-controlling prediction, since it reduces to the latter when the predictors are set-valued with the nesting property and the losses are monotone. The loss-controlling guarantee of the proposed framework is established in the asymptotic setting and is empirically verified in selective regression and high-impact weather forecasting, demonstrating its effectiveness for the domains requiring general loss-controlling prediction.
cs.LG