← 研踪 PaperTrailCVF · CVPR 2026:cvf:8732c3035562b25f76dce35770b41438 · 记录 #1
Twin-T & TwintVQA: A Reliable Structure-Detail Separating VLM and a Comprehensive Benchmark for Chart and Table Tasks
来源日期(仅到年份) 2026
来源记录日期 2026
雷达观测 2026-11-01 23:04
摘要
With the rapid development of Vision-Language Models (VLMs), there is a growing demand for automatic analysis of structured visual data. Charts and tables carry quantitative information through regular layouts, explicit numbers, and chart-specific reading patterns, yet current VLMs still underuse these properties, often causing value errors and unreliable analysis. To overcome these limitations, we propose Twin-T, a two-stage expert VLM for comprehensive chart-table tasks across Image, LaTeX, and Python. In stage 1, we propose a dual-head image encoder that can separate structural cues and fine details from input images. In stage 2, we propose MINT, a preference learning method that emphasizes numerical and keyword fidelity, as well as vision-text matching. Furthermore, we introduce a comprehensive TwintVQA benchmark with 17 chart types, 11 task types, 3 data formats, and short / medium / long QA settings. Our model narrows the gap between open-source and closed-source models on mainstream chart-table benchmarks, outperforming open-source models while even remaining competitive with GPT-4o and Gemini-2.5-Pro.
论文发现出处
这些页面提供论文线索,不代表同行评审或质量认证。
观测到的版本
平台记录号代表本站观测到的元数据变化,不是作者修订号。来源日期仅到月份或年份时,按该月或该年首日存档。
记录 #1 · 2026 · 最新观测版本
Twin-T & TwintVQA: A Reliable Structure-Detail Separating VLM and a Comprehensive Benchmark for Chart and Table Tasks
With the rapid development of Vision-Language Models (VLMs), there is a growing demand for automatic analysis of structured visual data. Charts and tables carry quantitative information through regular layouts, explicit numbers, and chart-specific reading patterns, yet current VLMs still underuse these properties, often causing value errors and unreliable analysis. To overcome these limitations, we propose Twin-T, a two-stage expert VLM for comprehensive chart-table tasks across Image, LaTeX, and Python. In stage 1, we propose a dual-head image encoder that can separate structural cues and fine details from input images. In stage 2, we propose MINT, a preference learning method that emphasizes numerical and keyword fidelity, as well as vision-text matching. Furthermore, we introduce a comprehensive TwintVQA benchmark with 17 chart types, 11 task types, 3 data formats, and short / medium / long QA settings. Our model narrows the gap between open-source and closed-source models on mainstream chart-table benchmarks, outperforming open-source models while even remaining competitive with GPT-4o and Gemini-2.5-Pro.
查看此版本解读 →查看此版本原文 ↗