Scientist World:为 AI 科学家构建可运行的研究世界
Scientist World: Grow a Research World for AI-Scientists
Taiming Lu, Sachin Konan, Zhuang Liu
AI 速读 基于摘要
作者提出将每篇论文转化为可执行环境,构建供 AI-Scientist 研究与训练的世界,并报告首批 1000 个已验证环境及初步评测与训练结果。
cs.AI · cs.CL · cs.LG
查看原文摘要
AI-Scientists arrived, but a world for them to grow in did not. Human scientists take theirs for granted $-$ centuries of open problems and shared ideas, waiting in the scientific literature. To AI-Scientists, that world is readable but not runnable, so we build Scientist World for them: every research paper becomes an executable environment. Our autonomous pipeline extracts each paper's open-ended research question and reproduces its proposed method as the baseline; an AI-Scientist entering the environment is evaluated against what the human authors achieved. We release the first 1,000 verified environments. With the world as an evaluation, we found that frontier AI-Scientists can already surpass the human researchers 74% of the time. As a record of how AI does science, it contains 6,400 hours of research traces, with every idea, experiment, failure, and success. As a training ground, we are able to raise (+158%) a small model to match frontier models in research ideation. At last, AI-Scientists' own world has arrived, grown from and growing with science itself.