AnimWeb-Bench:从视频生成动画网页代码的基准测试
AnimWeb-Bench: Benchmarking Animated Webpage Code Generation from Videos
Zhongyi Zhang, Jingyu Xiao, Shuqing Li, Michael R. Lyu
AI 速读 基于摘要
作者提出首个从视频生成完整动画网页代码的基准 AnimWeb-Bench,并设计静态外观与动画保真度二维评测协议,对14个多模态大模型和3个编码智能体进行了评测。
cs.SE · cs.CV
查看原文摘要
Animation is pervasive on the Web, the CSS animation property alone appears on over three-quarters of webpages. Yet existing webpage code generation benchmarks target static screenshots, user-triggered interactions, or isolated motion graphics, leaving the ability of multimodal large language models (MLLMs) and coding agents to reconstruct complete animated webpages largely unexplored. To fill this gap, we introduce AnimWeb-Bench, the first benchmark for animated webpage code generation from videos. It comprises 124 real-world webpages spanning 7 application domains and 33 animation types, with 91.9% of pages combining multiple types, each paired with a reference video and the static assets of the original webpage. We further propose a human-aligned, two-dimensional evaluation protocol: Static Appearance Fidelity measures structure, text, color, and visual similarity on aligned keyframes, while Animation Fidelity tracks UI components across frames and compares their position, size, velocity, and appearance with those in the reference video. Evaluating 14 MLLMs and three coding agents reveals: (1) reproducing webpage animations is substantially more difficult than reproducing static appearance; (2) explicit frame inspection and render feedback improve the reconstruction quality of coding agents; and (3) rapid, continuous changes are harder to reproduce than discrete state transitions. Our code and dataset are available at https://starry1001.github.io/AnimWeb-Bench-website/ .