隐式生成模型的收缩先验
Shrinkage prior for implicit generative models
Shreya Sinha-Roy, Christian P. Robert, Ritabrata Dutta
AI 速读 基于摘要
作者提出一种基于收缩先验与广义贝叶斯的样本高效训练机制,用于隐式生成模型,并在高维小样本场景下探索稀疏表示。
cs.LG · stat.CO
查看原文摘要
Implicit generative models based on deep neural networks have revolutionized many scientific fields, from weather research to language generation. They successfully model complex random objects arising in real-world problems. In this work, we propose a sample-efficient training mechanism for these models. Our approach leverages regularized inference with shrinkage priors and generalized Bayes. In the large $p$ (parameter dimension) and small $n$ (sample size) setting, sparsity-inducing priors have been successfully used for linear regression when $p \gg n$. However, their application to implicit generative models remains challenging due to the intractability of the likelihood function. To address this, we adapt a scoring rule posterior based on a strictly proper scoring rule, following the generalized Bayes framework. We then propose a block SGMCMC within Gibbs sampling mechanism. This enables efficient exploration of high-dimensional parameter spaces by identifying a sparse representation of neural implicit generative models. We demonstrate the performance of our proposed method through experiments on $p \gg n$ linear regression and an application of neural generative models.