从数据到程序:从经验数据快速直接生成程序推断
From Data to Program: Fast & Direct Generative Program Inference from Empirical Data
Simon Klüttermann, Xueying Ding, Leman Akoglu
AI 速读 基于摘要
PRODiGI 是一个预训练的数据到程序模型,单次前向传播即可从经验数据推断出显式可执行的生成程序,并支持程序空间微调。
cs.LG · cs.AI
查看原文摘要
Estimating probability densities from a finite set of samples typically requires dataset-specific model fitting. We introduce PRODiGI, a pretrained data-to-program model that infers an explicit, executable generative program in a single forward pass. Pretrained on synthetic datasets paired with their ground-truth programs, PRODiGI accommodates diverse generative families and data dimensionalities through template prediction and non-autoregressive program parameter decoding. Its inferred programs support direct sampling, density and score evaluation, and inspection independently of the pretrained model. We further introduce program-space fine-tuning, which refines differentiable program parameters by maximizing the likelihood of empirical data while keeping model parameters intact. Experiments show that PRODiGI-FT achieves better density and score metrics than existing pretrained models, while offering multi-fold speedups over its closest competitors. Program-space fine-tuning further reduces generation MMD by 90%. By turning empirical data into explicit, reusable programs, PRODiGI introduces a new direction for fast, interpretable tabular generative modeling.