Evo-DexBench: Benchmarking Generalization across Related Tasks for Dexterous Manipulation
Bing Cheng, Yiran Mao, Zewei Ye, Yifan Jin, Xinyi Chen, Ruifeng Tu, Shuhuai Wang, Tao Lin 等 13 位作者
原文摘要
General-purpose dexterous manipulation requires policies to transfer knowledge from related tasks to new tasks with only a few target demonstrations. Existing benchmarks often provide too many target demonstrations and leave the differences between source and target tasks uncontrolled. As a result, they cannot clearly distinguish knowledge transfer from task memorization. Our key insight is the Core-Gen principle. Core tasks are related tasks that share a functional interaction and provide source knowledge, while a Gen task is a novel target within the same functional family that has only a few demonstrations. This setup tests whether a policy can reuse functional interaction knowledge. Based on this principle, we propose Evo-DexBench, which controls both source-task relatedness and target-task exposure. It comprises 30 tasks in six functional families, three everyday layouts per task, and 1,248 multimodal demonstrations collected via VR teleoperation with simulated Shadow Hands equipped with 123 taxels. We first compare few-shot adaptation strategies and find that joint Core + Gen training makes the most effective use of Core knowledge. Under this setting, we evaluate six representative policies. The best-performing policy, $π_{0.5}$, achieves a mean success rate of only 24.4%, revealing the limitations of existing methods in transferring functional interaction knowledge. Further analysis shows that on the tested Gen targets, functionally matched Core data yields larger success-rate gains than mismatched data, and that with matched Core data, 8 Gen demonstrations reach the performance of training on 16--32 Gen demonstrations alone. These results indicate that Evo-DexBench separates knowledge transfer from task memorization under controlled conditions and effectively evaluates the generalization of dexterous manipulation policies across related tasks.
cs.RO