← 研踪 PaperTrailarXiv:2611.09964 · v2
How Many Demonstrations Does a VLA Need? On the Sample Efficiency of VLA Finetuning
首次提交 2026-10-28 18:26
版本更新 2026-11-10 17:26
雷达观测 2026-11-11 13:08
摘要
Pretrained vision language action (VLA) models show strong zero-shot performance but they are rarely deployed directly and are often first post-trained on demonstrations from the target setting. Yet VLAs are typically compared by zero-shot or full-data fine-tuned success which reveals little about the data and compute required for downstream adaptation. We study adaptation efficiency for six VLAs (, , and GR00T N1-N1.7) on four LIBERO suites, varying both demonstrations and training steps. This reveals differences hidden by full-data fine-tuning: models which are within two points on the full LIBERO-Spatial dataset differ by up to 3 in success with 50 demonstrations. needs 2-5 fewer demonstrations than and is the most sample-efficient model at every budget, with the largest gap on the long-horizon suite. Within GR00T, N1.5 adapts more efficiently than N1.6 and N1.7 on three of four suites, despite their stronger zero-shot performance. We also study one pretraining factor behind these differences by freezing the VLM during finetuning: this severely degrades the models whose VLM is jointly trained with the action expert during pretraining, but barely affects GR00T models.
作者备注:14 pages, 8 figures, CoRL Workshop
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-10 17:26 · 最新观测版本
How Many Demonstrations Does a VLA Need? On the Sample Efficiency of VLA Finetuning
Pretrained vision language action (VLA) models show strong zero-shot performance but they are rarely deployed directly and are often first post-trained on demonstrations from the target setting. Yet VLAs are typically compared by zero-shot or full-data fine-tuned success which reveals little about the data and compute required for downstream adaptation. We study adaptation efficiency for six VLAs (, , and GR00T N1-N1.7) on four LIBERO suites, varying both demonstrations and training steps. This reveals differences hidden by full-data fine-tuning: models which are within two points on the full LIBERO-Spatial dataset differ by up to 3 in success with 50 demonstrations. needs 2-5 fewer demonstrations than and is the most sample-efficient model at every budget, with the largest gap on the long-horizon suite. Within GR00T, N1.5 adapts more efficiently than N1.6 and N1.7 on three of four suites, despite their stronger zero-shot performance. We also study one pretraining factor behind these differences by freezing the VLM during finetuning: this severely degrades the models whose VLM is jointly trained with the action expert during pretraining, but barely affects GR00T models.
查看此版本解读 →查看此版本原文 ↗