跳到正文
研踪PaperTrail
← 研踪 PaperTrail

arXiv:2611.17626 · v1

Joint World Action Models through Differentiable Trajectory Optimization

首次提交 2026-11-13 08:54
版本更新 2026-11-13 08:54
雷达观测 2026-11-17 04:57
arXiv ↗PDF ↗

摘要

Joint world action models (WAMs) generate future actions and states together, modeling world-action trajectories rather than actions alone. However, trajectory imitation does not ensure that these trajectories are task-effective or consistent with dynamics. We present \textbf{world action trajectory optimization (WATO)}, which optimizes generated actions and future states jointly for control. WATO uses both as references in a dynamics-constrained trajectory optimization problem and differentiates the task loss through the optimized trajectory to train the generator. This makes generated trajectories task-aware and dynamics-consistent while using trajectory optimization only during training. At deployment, WATO directly generates candidate trajectories and ranks them with a world model, without iterative trajectory optimization. Across 77 visual control environments, WATO improves average success from 79.9%79.9\% for the imitation joint WAM to 91.7%91.7\%, outperforming strong model-based, goal-conditioned RL, and generative control baselines. Compared with cross-entropy method (CEM), WATO is on average 11.5×11.5\times faster and uses 600.5×600.5\times fewer world model evaluations at deployment.

作者备注:29 pages, 6 figures, 14 tables

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

目前只收录了一个版本。收录下一版后,可以对照标题、作者、分类和摘要。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v1 · 2026-11-13 08:54 · 最新观测版本

Joint World Action Models through Differentiable Trajectory Optimization

Joint world action models (WAMs) generate future actions and states together, modeling world-action trajectories rather than actions alone. However, trajectory imitation does not ensure that these trajectories are task-effective or consistent with dynamics. We present \textbf{world action trajectory optimization (WATO)}, which optimizes generated actions and future states jointly for control. WATO uses both as references in a dynamics-constrained trajectory optimization problem and differentiates the task loss through the optimized trajectory to train the generator. This makes generated trajectories task-aware and dynamics-consistent while using trajectory optimization only during training. At deployment, WATO directly generates candidate trajectories and ranks them with a world model, without iterative trajectory optimization. Across 77 visual control environments, WATO improves average success from 79.9%79.9\% for the imitation joint WAM to 91.7%91.7\%, outperforming strong model-based, goal-conditioned RL, and generative control baselines. Compared with cross-entropy method (CEM), WATO is on average 11.5×11.5\times faster and uses 600.5×600.5\times fewer world model evaluations at deployment.

查看此版本解读 →查看此版本原文 ↗