← 研踪 PaperTrailarXiv:2608.13438 · v2
ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
首次提交 2026-08-14 00:25
版本更新 2026-11-15 06:35
雷达观测 2026-11-17 12:06
摘要
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce ContactGuard, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard consistently benefits from action-conditioned latent prediction over current-state and direct-prediction alternatives. Counterfactual action perturbations further show that its failure score responds to the specific action being proposed. We deploy the same frozen monitor online with the visuomotor policy, where it provides a pre-contact abort signal without modifying the underlying policy.
作者备注:14 pages, 4 figures, 7 tables
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-15 06:35 · 最新观测版本
ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce ContactGuard, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard consistently benefits from action-conditioned latent prediction over current-state and direct-prediction alternatives. Counterfactual action perturbations further show that its failure score responds to the specific action being proposed. We deploy the same frozen monitor online with the visuomotor policy, where it provides a pre-contact abort signal without modifying the underlying policy.
查看此版本解读 →查看此版本原文 ↗