← 研踪 PaperTrailarXiv:2610.04425 · v3
AgroGround: What Grounding Fine-Tuning Changes in Agricultural Vision-Language Models
首次提交 2026-10-03 18:27
版本更新 2026-11-19 15:39
雷达观测 2026-11-20 19:58
摘要
Large-scale agricultural grounding data can now be generated automatically, but how training on such data affects a vision-language model's localization, recognition, and refusal capabilities remains unclear. To study these effects, we introduce AgroGround, containing 794,850 automatically grounded agricultural instructions for training and a separate benchmark of 1,478 human-verified images for evaluation. Among these images, 500 are independently re-annotated, yielding an inter-annotator instance F1 of 0.789. We use controlled comparisons to isolate the effects of different training choices on localization, recognition, their joint correctness, and refusal. Grounding-only fine-tuning reduces four-way recognition from 51.7% to 29.2%, with predictions showing a strong candidate-position bias. However, changing only the instruction format raises recognition to 72.7% while maintaining similar grounding performance. Training with healthy-image negatives achieves 94.1% refusal on healthy images, but only 28.6% refusal of incorrect target names on positive images, showing that these two refusal behaviors do not necessarily improve together. Reinforcement learning reveals a further trade-off, improving localization by 0.014 F1 over a matched supervised control while reducing recognition and refusal. Across model families and held-out training sources, localization transfers more reliably than recognition and target-specific refusal. External benchmarks further show that the gains depend on the domain and task. Together, these findings show that grounding fine-tuning changes the balance between localization, recognition, and refusal rather than improving all three uniformly.
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v3 · 2026-11-19 15:39 · 最新观测版本
AgroGround: What Grounding Fine-Tuning Changes in Agricultural Vision-Language Models
Large-scale agricultural grounding data can now be generated automatically, but how training on such data affects a vision-language model's localization, recognition, and refusal capabilities remains unclear. To study these effects, we introduce AgroGround, containing 794,850 automatically grounded agricultural instructions for training and a separate benchmark of 1,478 human-verified images for evaluation. Among these images, 500 are independently re-annotated, yielding an inter-annotator instance F1 of 0.789. We use controlled comparisons to isolate the effects of different training choices on localization, recognition, their joint correctness, and refusal. Grounding-only fine-tuning reduces four-way recognition from 51.7% to 29.2%, with predictions showing a strong candidate-position bias. However, changing only the instruction format raises recognition to 72.7% while maintaining similar grounding performance. Training with healthy-image negatives achieves 94.1% refusal on healthy images, but only 28.6% refusal of incorrect target names on positive images, showing that these two refusal behaviors do not necessarily improve together. Reinforcement learning reveals a further trade-off, improving localization by 0.014 F1 over a matched supervised control while reducing recognition and refusal. Across model families and held-out training sources, localization transfers more reliably than recognition and target-specific refusal. External benchmarks further show that the gains depend on the domain and task. Together, these findings show that grounding fine-tuning changes the balance between localization, recognition, and refusal rather than improving all three uniformly.
查看此版本解读 →查看此版本原文 ↗