Can Wang, Qiyuan Qiao, Lei Liu, Ge Yuan, Xinhui Liu, Dong Xu
原文摘要
Learning robust manipulation policies for diverse everyday objects remains challenging because objects with different materials exhibit distinct deformation and contact dynamics. While diffusion policies provide a powerful framework for modeling multimodal manipulation behaviors, they typically lack explicit physical reasoning and may produce averaged actions when facing heterogeneous objects. We present a physics-aware diffusion policy that augments visual imitation learning with object physical understanding. Our framework recovers material properties from visual demonstrations by coupling 3D Gaussian Splatting with differentiable Material Point Method simulation, where video guidance and particle-level constraints enable accurate physical parameter estimation. The estimated physics conditions are further integrated into a material-aware Mixture-of-Experts diffusion policy, allowing adaptive behavior generation across different physical regimes. For practical deployment, we introduce a physics memory bank that provides efficient physical retrieval without requiring online simulation optimization. Experiments on a wide range of simulated and real-world objects demonstrate improved manipulation success and generalization over existing diffusion-based approaches. These results show that incorporating physical knowledge is critical for scalable robot manipulation in diverse environments.
Yilin Yao, Bin Lu, Xinhui Li, Meng Jin, Xinbing Wang
原文摘要
Dynamic web interactions continuously evolve as new edges arrive, offering large language models (LLMs) great potential for reasoning over edge-level temporal semantics. However, continuously arriving edges are often repetitive, obscuring the key structures that truly reflect temporal changes and limiting the efficiency of LLMs. A key insight is that beneath the dense stream of edge arrivals lies a sparse evolution of temporal intent, enabling LLMs to be responsively triggered only when such intent shifts, while otherwise inheriting the previous state. To this end, we propose a hypergraph-based framework named HyperIntent, which enhances dynamic graph reasoning by parsing differentiated intents, quantifying their temporal discrepancies, and performing shift-triggered semantic updating. Experimental results on destination node retrieval and future link prediction demonstrate that HyperIntent consistently achieves the best overall performance, with average relative Hits@1 gains of 34.0% and 25.4% over vanilla TGAT and DyGFormer, respectively. Meanwhile, HyperIntent reduces LLM token consumption by 54.4%-95.9% across six datasets while achieving leading predictive performance. In-depth studies further confirm the necessity of shift triggering for identifying structural and semantic temporal changes. The code will be made publicly available upon completion of the review process.