← 研踪 PaperTrailarXiv:2610.41012 · v3
Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts
首次提交 2026-10-30 05:45
版本更新 2026-11-17 23:53
雷达观测 2026-11-18 16:38
摘要
Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v3 · 2026-11-17 23:53 · 最新观测版本
Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts
Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.
查看此版本解读 →查看此版本原文 ↗v2 · 2026-11-16 06:18
Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts
Repeated passages in retrieved evidence may influence how language models identify misinformation, even when those passages restate a single underlying claim rather than provide independent support. We compare four instruction-tuned models on 200 claims from the BEIR SciFact test split using paired, fixed seven-document contexts. The minority condition contains one poisoned document and six non-target documents, whereas the majority condition contains the original poisoned document, five paraphrases, and one non-target document. Poison detection rates increase from 45.5% to 66.0% for Apertus-8B and from 4.0% to 15.5% for Aya-Expanse-8B, but decrease from 80.0% to 47.5% for Mistral-Nemo and from 25.0% to 9.5% for Gemma-3-12B-IT. All four paired comparisons are statistically significant. These contrasting results suggest that repeated poisoned evidence does not affect all models in the same way. One possible interpretation is that repetition makes the poisoned claim more conspicuous to some models, potentially facilitating its detection, while other models may treat repeated formulations as reinforcing evidence, potentially reducing their ability to identify the poisoned claim. Although these interpretations require further investigation, the findings highlight the importance of model-dependent responses to repeated evidence in retrieval-augmented settings.
查看此版本解读 →查看此版本原文 ↗