跳到正文
研踪PaperTrail

YOUR RESEARCH, IN SIGHT

让下一篇重要论文,不再错过。

覆盖计算机全学科,以 AI 为快捷入口。关注方向、作者和关键词,把发现变成持续的研究积累。

部分采集异常
正在读取账号与研究记录…

全站更新概况

+1072新增论文
+845其中 AI 相关
+94已有论文修订
+100新增 AI 导读

arXiv 最近完成扫描:2026-11-10 09:10 · 全站最近入库:2026-11-09 13:22各信源进度 →

统计口径与数据新鲜度

统计 2026-11-09 09:36 — 2026-11-10 09:36(北京时间) · 点击数字查看对应简报;AI 相关包含在新增论文内。

最近完成检查:2026-11-10 09:10最近发现新增版本:2026-11-09 13:22库内论文最新更新时间:2026-11-07 02:59

每分钟刷新已保存的数据。空检查不代表采集异常;新收录可能包含历史论文。AI 导读按新增版本计数。

18,172 已收录论文15,506 AI 相关4,527 有修订112 HF 社区发现

浏览论文库

时间范围跟随排序:版本更新、本站收录或首次发表。最新收录可能包含历史论文。部分信源异常,查看状态 →

找到 4 篇论文 · 按版本更新时间排序上轮扫描起点 2026-11-10 09:09(北京时间)
新论文 · v1arXiv:2611.07876

Which Signals of Code Correctness Survive Distribution Shift? Hidden-State and Causal Predictors of Program and Verdict Correctness

Viola Campos, Thomas Klassert, Adrian Ulges

原文摘要

Large language models increasingly judge code, yet without external feedback such judgments are unreliable, and verifying them by executing tests or by extended reasoning is costly. Instead, execution-free correctness predictors use signals from the model's output probabilities, sampled solutions, or hidden states to identify judgments that warrant further verification. However, these predictors may degrade under distribution shifts when generalizing across projects and languages. We compare six execution-free predictors from four families on Qwen3-Coder-30B and gpt-oss-20b under benchmark shift between LiveCodeBench and BigCodeBench and language shift across Python, C++ and Java. We evaluate two targets: whether the model's own verdict on a program can be trusted, and whether the program itself is correct. Besides established approaches, we adapt two novel causal localization methods to code, which have been shown to be more robust out-of-distribution on natural language tasks. For verdict correctness, causal localization improves robustness to language shift. For Qwen3-Coder a probe on the causally localized subspace stays 0.09 AUROC ahead of output confidence under language shift (0.11 in distribution), significantly outperforming the best non-causal predictor by 0.04 AUROC on average. This advantage, however, does not generalize consistently to gpt-oss or to benchmark shift. For program correctness, predictors transfer more successfully between benchmarks, largely by identifying problems on which the model tends to fail. However, their ability to rank candidates within the same problem is limited.

cs.SE · cs.LG

新论文 · v1arXiv:2611.04003

WASP-Mem: Let Agent Organize Procedural Memory. Human Spend Effort on Diagnosis

Peizhi Niu, Ge Shi, Vaibhav Gorde, Sarthak Ghosh, Christos Faloutsos, Min Cheng, Kevin Chen

原文摘要

LLM agents struggle to automate complex enterprise procedures because static, pre-built harness cannot capture proprietary policies, undocumented behaviors, or state-dependent recovery paths that surface only during execution. Procedural memory accrued from agent experience offers a training-free path to closing this gap -- yet unlike episodic records or semantic facts, it must consolidate repeated successes and diagnosed failures into reusable actions and recovery strategies. We introduce WASP-Mem (Wiki-based Agent-Synthesized Procedural Memory), a nimble but effective method that distills execution traces and feedback into persistent, interlinked wiki pages, enabling continual agent learning. On TheAgentCompany benchmark, WASP-Mem raises the checkpoint pass rate by 4.6-6.1% over the strongest baseline we compared across three models while requiring 57-61% less storage. We further present a systematic controlled study spanning consolidation method, feedback type, trace ingestion scope, and refinement rounds. Our results reveal that prescriptive knowledge organization such as human defined schemas and explicit deduplication rules hurts performance rather than closing the procedural-knowledge gap. In contrast, human diagnosis converts failed traces into corrective knowledge and drives sustained improvement: a single round of human diagnosis outperforms four rounds of self-judgment by 7.0-10.9%. These findings point to a simple division of labor: let agents organize procedural memory, and invest human effort where it matters most -- diagnosis.

cs.AI · cs.CL · cs.LG

版本更新 · v2arXiv:2603.02258

Universal Conceptual Structure in Neural Translation: Probing NLLB-200's Multilingual Geometry

Kyle Elliott Mathewson

原文摘要

Do multilingual translation models organize meaning around a shared conceptual space, or do they primarily encode language identity and surface form? We probe the encoder geometry of Meta's 600M-parameter NLLB-200 model across 135 languages and 101 Swadesh concepts in contextualized carrier-frame and decontextualized bare-word regimes against null and confound controls. First, two-way variance partitioning reveals an additive language-shift plus conceptual-manifold geometry: language shifts account for 45.7% of variance on bare words vs. 13.7% in context, and mean-centering improves the between-to-within-concept distance ratio (vs. a 0.99 permutation null) by 2.14x on bare words (1.15 to 2.46; 2.27x across disjoint scripts) and 1.19x in context (2.25 to 2.69), with conceptual separation peaking at Layer 10 (mutual k-NN overlap jumping 4.35x). Second, semantic category explains 25.4% of Swadesh convergence variance ($F(7,93)=4.53$, $p=2.21\times 10^{-4}$; partial $F=7.74$ controlling for fertility and length)---over 20x orthography or phonology ($R^2\le 0.012$)---while the advantage of Swadesh over non-loanword concrete nouns ($d=0.54$--$0.69$) is mediated by Zipfian subword compactness ($p=7.43\times 10^{-7}$). Third, language distances track ASJP NLD and LDND phonetic distances within subfamilies under block-permutation and cross-script controls ($ρ_s=0.65$--$0.67$, block $p=10^{-4}$; global bare-word Mantel $ρ_s=0.24$, $p=0.001$), and CLICS$^3$ colexified concepts lie closer across string-distinct, within-category ($ρ_s=0.32$), and bare-word ($d=1.79$) controls ($d=1.43$, $p=1.55\times 10^{-33}$). Finally, basic color terms recover the Berlin and Kay hierarchy ($ρ_s=0.91$--$0.93$, $p\le 2.18\times 10^{-4}$), and semantic offsets exceed distance-matched controls ($p=3.55\times 10^{-5}$, $d=1.06$). We release InterpretCognates, an interactive toolkit and reproducible suite.

cs.CL · cs.AI · cs.LG

版本更新 · v2arXiv:2610.34044

A Sign Law for Entropy Drift under Sampler Mismatch in RLVR

Zhiyuan Wang, Jacob Steeves, Chang Liu

原文摘要

In reinforcement learning with verifiable rewards (RLVR), whether entropy rises or falls can depend on choices that matter little under exact sampling, such as whether over-length responses are masked or counted as failures. We trace this to sampler mismatch: rollouts are drawn with top-k/top-p truncation or at a temperature the learner does not apply. We prove that a constant advantage shift then changes the entropy of a softmax policy, at first order and in expectation, with a sign fixed by the sampler. Positive shifts sharpen the policy under any sampler whose likelihood ratio to the policy increases with token probability, including top-k, top-p, min-p, and temperatures below one, and flatten it under flatter samplers. In group-based RLVR with token-level losses, the baseline-dependent part of this drift is set by the token-weighted net advantage, which masking and failing can push to opposite signs. The rest comes from a covariance between advantages and the sampler's sharpness gap and feeds back on itself: in a two-level model, a push away from a sharper sampler takes off in finite time, while a pull toward it saturates. On a 2B model, the entropy slope is linear in shifts of the net advantage under truncated sampling and indistinguishable from flat under exact sampling. Token-level importance ratios leave 98% of the drift, and four clipped minibatch updates per batch amplify it sevenfold. In 100-step runs, a net-zero baseline only delays an entropy explosion, and entropy raised at the start keeps rising only under truncation; cancelling the first-order drift at every step keeps entropy bounded without changing the learner. On a 9B reasoning model forked from an uncorrected run, zeroing the net advantage or renormalizing the learner raises held-out accuracy after ten steps by 8.2 and 8.8 points over the uncorrected rule, with no difference under exact sampling.

cs.LG · cs.AI