极性组合假说:来自自然语言推理中否定的因果证据
Polarity Composition Hypothesis: Causal Evidence from Negation in NLI
Nhi Hoai Doan, Tatsuya Hiraoka, Munachiso Samuel Nwadike, Kentaro Inui
AI 速读 基于摘要
作者提出“极性组合假说”作为语言模型处理自然语言推理中否定的高层因果模型,并通过行为评估与分布式对齐搜索寻找与之对应的因果子空间。
cs.CL
查看原文摘要
We investigate how language models process negation in natural language inference (NLI). We propose the \textit{Polarity Composition Hypothesis}, a high-level causal model of this computation. Behavioral evaluations show that language-model predictions largely conform to the proposed hypothesis. Using Distributed Alignment Search, we identify causally effective subspaces aligned with the variables in the polarity-composition hypothesis. These representations transfer across negation forms and partially to a subset of MNLI. We release the dataset and code.