RSI-Prime:训练模型去训练模型
RSI-Prime: Training Models to Train Models
Dewu Zheng, Yang Ye, Hongyu Zhang, Jun Yu, Yanlin Wang
AI 速读 基于摘要
作者构建了 RSI-Prime 数据集,用于提升大语言模型的模型训练能力,并在 PostTrainBench 上报告了 GLM-5.3 的性能相对提升。
cs.AI · cs.LG
查看原文摘要
Enabling large language models (LLMs) to autonomously conduct training and improve target models is an important foundation for recursive self-improvement (RSI). As LLMs expand their role from being trained to conducting training, their model-training capability warrants dedicated study and systematic development. To this end, we construct RSI-Prime, a dataset for improving model-training capability, comprising 350 complete experimental trajectories across seven task categories. To help LLMs learn to make high-quality experimental decisions from training practice, we perform fine-grained decision identification and quality annotation, then apply decision-level loss masking to exclude supervision on low-quality behavior. Experiments with GLM-5.3 on PostTrainBench, a benchmark for autonomous post-training, show that training on RSI-Prime yields a 31.95% relative improvement in overall performance over the original GLM-5.3, highlighting a path toward future RSI systems in which models autonomously sustain their own advancement.