← 研踪 PaperTrailarXiv:2602.18224 · v2
SimVLA: Attributing Gains in VLA Models Through Controlled Ablation
首次提交 2026-02-20 22:04
版本更新 2026-11-19 13:50
雷达观测 2026-11-20 19:58
摘要
Vision-Language-Action (VLA) models often bundle architectural changes with different pretraining data, backbone scales, and optimization recipes, obscuring what actually drives progress. We introduce SimVLA, a deliberately minimal VLA, a standard vision-language backbone with a lightweight continuous-action head, as a controlled testbed for this attribution problem; our contribution is methodological and empirical (a controlled attribution study and a minimal-baseline calibration), not a new technique. Across LIBERO, CALVIN, WidowX, and Google Robot, one-knob-at-a-time ablations show that training dynamics are the largest measured driver, producing performance swings of 54--94\%, while task configuration and architecture have smaller effects under matched settings. Despite using a small backbone and no additional large-scale robot-data VLA pretraining before benchmark-specific training, SimVLA reaches 98.6\% average success on LIBERO, remains competitive across the other benchmarks, and transfers to held-out real-robot scenes. These results suggest that simple, carefully controlled VLA baselines remain underexplored and provide a calibration point for future architectural claims within the VLM-encoder plus lightweight-head family. Website: https://frontierrobo.github.io/SimVLA
作者备注:NeurIPS 2026
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-19 13:50 · 最新观测版本
SimVLA: Attributing Gains in VLA Models Through Controlled Ablation
Vision-Language-Action (VLA) models often bundle architectural changes with different pretraining data, backbone scales, and optimization recipes, obscuring what actually drives progress. We introduce SimVLA, a deliberately minimal VLA, a standard vision-language backbone with a lightweight continuous-action head, as a controlled testbed for this attribution problem; our contribution is methodological and empirical (a controlled attribution study and a minimal-baseline calibration), not a new technique. Across LIBERO, CALVIN, WidowX, and Google Robot, one-knob-at-a-time ablations show that training dynamics are the largest measured driver, producing performance swings of 54--94\%, while task configuration and architecture have smaller effects under matched settings. Despite using a small backbone and no additional large-scale robot-data VLA pretraining before benchmark-specific training, SimVLA reaches 98.6\% average success on LIBERO, remains competitive across the other benchmarks, and transfers to held-out real-robot scenes. These results suggest that simple, carefully controlled VLA baselines remain underexplored and provide a calibration point for future architectural claims within the VLM-encoder plus lightweight-head family. Website: https://frontierrobo.github.io/SimVLA
查看此版本解读 →查看此版本原文 ↗