跳到正文
研踪PaperTrail
← 研踪 PaperTrail
正在查看已观测的 v2。查看最新 v3 →

arXiv:2610.41012 · v2

Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts

首次提交 2026-10-30 05:45
版本更新 2026-11-16 06:18
雷达观测 2026-11-17 17:12
arXiv ↗PDF ↗

摘要

Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

仅对比实际观测的元数据,不代表 PDF 正文或实验变化。版本可能不连续;带删除线为移除,下划线为新增。

这两个版本的已观测标题、作者、分类、摘要和备注没有变化。正文是否变化请核对原文。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v3 · 2026-11-17 23:53 · 最新观测版本

Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts

Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.

查看此版本解读 →查看此版本原文 ↗
v2 · 2026-11-16 06:18

Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts

Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.

查看此版本解读 →查看此版本原文 ↗