跳到正文
研踪PaperTrail

YOUR RESEARCH, IN SIGHT

让下一篇重要论文,不再错过。

覆盖计算机全学科,以 AI 为快捷入口。关注方向、作者和关键词,把发现变成持续的研究积累。

部分采集异常
正在读取账号与研究记录…

全站更新概况

+1028新增论文
+790其中 AI 相关
+128已有论文修订
+100新增 AI 导读

arXiv 最近完成扫描:2026-11-12 06:59 · 全站最近入库:2026-11-12 06:37各信源进度 →

统计口径与数据新鲜度

统计 2026-11-11 10:41 — 2026-11-12 10:41(北京时间) · 点击数字查看对应简报;AI 相关包含在新增论文内。

最近完成检查:2026-11-12 06:59最近发现新增版本:2026-11-12 06:37库内论文最新更新时间:2026-11-11 08:00

每分钟刷新已保存的数据。空检查不代表采集异常;新收录可能包含历史论文。AI 导读按新增版本计数。

21,675 已收录论文18,323 AI 相关6,056 有修订112 HF 社区发现

浏览论文库

时间范围跟随排序:版本更新、本站收录或首次发表。最新收录可能包含历史论文。部分信源异常,查看状态 →

找到 5,654 篇论文 · 按版本更新时间排序上轮扫描起点 2026-11-12 06:57(北京时间)
首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-srw.95ACL Anthology · ACL 2026

TableMBR: Minimum Bayes Risk Table Generation Based on Structural Consistency

Daiki Yoshida Nara Institute of Science and Technology, Japan, Hiroyuki Deguchi NTT, Yusuke Sakai Nara Institute of Science and Technology, Japan, Hidetaka Kamigaito CyberAgent, Inc. and Nara Institute of Science and Technology, Taro Watanabe Nara Institute of Science and Technology, Japan

原文摘要

The text-to-table task aims to generate structured data in tabular formats from unstructured text. While the integration of large language models (LLMs) has significantly enhanced the comprehensiveness and flexibility of generation, challenges regarding inconsistent output quality persist, such as the inclusion of redundant information and numerical inaccuracies. We propose TableMBR, a robust table generation method that maintains structural consistency through minimum Bayes risk (MBR) decoding. Experimental results showed that TableMBR outperforms the baseline, achieving relative improvements of up to 15% in F1 score on Rotowire and 23% in accuracy on LiveSum.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-srw.96ACL Anthology · ACL 2026

Through the Looking Glass of Multilingual AI: Contrasting Language- and Name Script-Dependent Ethnic Hierarchies in GPT and DeepSeek

Annabella Sakunkoo Stanford University, Jonathan Sakunkoo University of Oxford

原文摘要

Large language models (LLMs) are increasingly used as evaluative tools across languages, yet bias research remains overwhelmingly Anglocentric, with most studies conducted in English using Latin-script names. It remains unclear whether bias patterns generalize across linguistic contexts. We investigate this question and introduce the stereotype perceptual map, a framework for analyzing how ethnic groups are positioned along evaluative dimensions.Using 900,000 model responses over 45,000 name variations spanning 9 ethnicities, we evaluate model behavior across prompt languages (English, Chinese, Thai), writing scripts (Latin, Chinese, Thai), evaluative domains (competence, warmth), and models (GPT, DeepSeek). We find that ethnic bias hierarchies are jointly shaped by local linguistic context and model origin and differ substantially between Western-centric and Sinocentric models.DeepSeek exhibits highly stable rankings across conditions in math competence judgments, consistently placing Chinese at the top, followed by Russian, and White, Hispanic, and Black names at the bottom. GPT, by contrast, shows strong script-dependent reordering: Latin-script conditions form one stable cluster, while native-script conditions form another, with substantially lower cross-cluster correlations. We term this script-gated bias: transliterating the same names into a non-Latin script can activate a different evaluative frame and produce rankings that are sometimes inversely correlated with Latin-script results. Warmth evaluations are less stable than competence across both models.Our findings demonstrate that multilingual bias cannot be characterized through single-language, single-script audits. For multilingual users, code-switching between languages can toggle between different bias regimes. Fairness evaluations for multilingual LLMs must therefore account for deployment language, writing system, and model origin to capture the full range of potentially harmful bias these systems exhibit.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-srw.97ACL Anthology · ACL 2026

Thesis Proposal: Auditing and Mitigating Demographic Bias in Multi-Stage Retrieval Systems for Criminal Justice Applications

Archan Dutta

原文摘要

We propose a comprehensive research agenda to detect, measure, and mitigate racial bias in Natural Language Processing (NLP) systems deployed in criminal justice contexts. Our preliminary work demonstrates that racial descriptors systematically alter embedding similarity scores and retrieval rankings across six models, with bias being race-specific and models showing rank displacements of 1.82 to 7.44 positions, on average. This empirically indicates that even small shifts in similarity scores can displace relevant records outside top-10 results, leading to systematic under-retrieval of records involving certain demographic groups.Building on these findings, this thesis proposes four research questions: (1) developing and evaluating debiasing techniques including counterfactual data augmentation, adversarial training, and fairness-constrained fine-tuning; (2) validating synthetic findings on authentic law enforcement data through IRB-approved partnerships; (3) investigating intersectional bias patterns across race, gender, and age; and (4) we extend beyond embedding-level analysis to examine how bias propagates across modern multi-stage retrieval pipelines from embeddings to cross-encoders to LLMs. Expected contributions include empirical comparisons of debiasing methods, bias benchmarks for criminal justice NLP, deployment guidelines for fairness-aware retrieval systems, and the first comprehensive analysis of multi-stage bias propagation in retrieval pipelines.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-srw.98ACL Anthology · ACL 2026

Contextual Diversity Measure (CDM) for Controllable Story Generation in Large Language Models

Richard Susilo Australian National University, Hanna Suominen Australian National University, Patrik Haslum Australian National University

原文摘要

Scenario-based text generation has broad applications across education and creative writing, but remains underexplored in controllable text generation. We introduce the Contextual Diversity Measure (CDM), a metric that quantifies semantic diversity for scenario generation under fixed abstract semantic constraints, and validate it through controlled experiments. Statistical analysis across four embedding models demonstrates that CDM successfully distinguishes between high-diversity and low-diversity text pairs, with all tests achieving statistical significance at p < 0.05 on both the manually curated and LLM-generated subsets of the dataset. Effect sizes range from small-to-medium (Cohen’s d: 0.292–0.508) on the former and medium-to-large (Cohen’s d: 0.677–1.195) on the latter. Baseline comparisons indicate that CDM achieves excellent discrimination accuracy (100% and 91.9%, respectively), with discriminative power up to 5.5\times greater than the best baseline.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-srw.99ACL Anthology · ACL 2026

Constructing a Japanese Verdict Prediction Dataset for Fact-Checking of LLM-Generated Texts

Miwa Masano, Hirokazu Kiyomaru National Institute of Informatics, Atsushi Keyaki Hitotsubashi University, Kaito Horio Waseda University, Rei Minamoto, Ribeka Keyaki Tokyo University of Technology, Kouta Nakayama NII, Tokyo Institute of Technology, Hideyuki Tachibana National Institute of Informatics and Asia University 等 9 位作者

原文摘要

The development of fact-checking systems for verifying the factuality of text generated by large language models (LLMs) has been advancing.In the verdict prediction step of such systems, the system determines whether claims in the generated text are supported by retrieved evidence, formulated as a natural language inference (NLI) task.This study extends the label set for verdict prediction to capture claim-evidence relationships that humans would commonly interpret as supported or refuted, even in the absence of strict logical entailment or contradiction.It also constructs a Japanese dataset comprising 28,147 instances from two sources based on this extended label set.We analyze the causes of annotation disagreement and find that ambiguity in the boundary of acceptable inference, interpretive characteristics of negative cases, and incomplete information in the evidence affect annotation variability.Using this dataset, we evaluate the performance of prompt-based verdict prediction methods and show that prompts that explicitly elicit chain-of-thought reasoning improve F1 by 4 percentage points compared to baseline.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.1ACL Anthology · ACL 2026

Future of Work in the Age of LLMs

Zora Wang Carnegie Mellon University, Yijia Shao Stanford University, David Nguyen Stanford University, Diyi Yang Stanford University

原文摘要

The recent development of large language models (LLMs) has revolutionized the landscape of human work. These models possess the ability to follow complex human instructions and operate versatile computer software, enabling them to participate in, augment, or even automate realistic occupational tasks that once thought to be exclusive to humans. As LLMs are increasingly integrated into workplaces, they are already reshaping labor dynamics (Hoffmann et al., 2024; Demirci et al., 2025) and raising urgent concerns about job displacement, diminished human agency, and overreliance on automation (Hazra et al., 2025). As a result, the future of work is undergoing a profound transformation: How will human occupations and task requirements evolve over time? And what roles will LLM-based systems play, as they become increasingly capable collaborators and autonomous workers? And how can we build technological and data infrastructures to support human-AI collaboration? This tutorial will provide an overview of the future of work shaped by the interplay of LLMs and humans, examining the emerging challenges, opportunities, and ethical considerations in this dynamic landscape. We begin by examining the economic landscape of work and how NLP technologies drive automation, followed by methods for developing LLMs that augment human labor and recent advances in LLM-based agents. We then cover evaluation approaches for workplace contexts, including datasets, benchmarks, and metrics, and conclude with open questions on technical, human, and societal implications.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.2ACL Anthology · ACL 2026

The Data Frontier for Large Language Models: Selection, Synthesis, and Tools

Lijun Wu Shanghai AI Laboratory, Wentao Zhang Peking University, Conghui He Shanghai AI Lab

原文摘要

As the development of Large Language Models (LLMs) matures, the focus of the research community is undergoing a critical shift from a purely model-centric to a data-centric paradigm. It is now evident that the quality, diversity, and composition of training data—not merely its scale—are the primary drivers of a model’s advanced capabilities, from complex reasoning to reliable instruction following. However, acquiring and curating such high-quality data remains a significant bottleneck. This tutorial provides a comprehensive and practical guide to the state-of-the-art in data research directions for LLMs. We structure the tutorial around the two core pillars of modern data strategy: intelligent data selection and advanced data synthesis. In the first part, we delve into methods for curating the most valuable information from vast, noisy datasets, covering techniques like LLM-as-a-judge for automated quality filtering and active learning for maximizing annotation efficiency. The second part explores the synthetic data revolution, detailing paradigms that range from generating complex reasoning traces (e.g., Chain-of-Thought) to deploying sophisticated multi-agent workflows that can autonomously create high-quality, diverse instruction data from raw seeds. Finally, we will conclude with a practical overview of open-source tools and platforms that facilitate these data-centric workflows, empowering researchers and practitioners to build better models through better data. Attendees will leave with a principled framework and actionable insights for designing and implementing the advanced data strategies required to build the next generation of powerful, specialized, and aligned LLMs.

cs.CL · cs.MA

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.3ACL Anthology · ACL 2026

Towards Effective and Efficient Multi-Agent Language Model Systems: Foundations, Prospects, and Applications

Xuan Wang Virginia Tech, Shuxiang Cao NVIDIA, Yuchen Zhuang Google DeepMind, Wenqi Shi University of Texas Southwestern Medical Center

原文摘要

Multi-agent systems powered by large language models (LLMs) offer a promising paradigm for tackling complex reasoning, decision-making, and problem-solving tasks. However, achieving both effectiveness and efficiency in such systems remains a critical challenge. This tutorial introduces recent advances in building effective and efficient multi-agent LLM systems, focusing on three core components. First, we discuss the design of individual LLM agents. We present state-of-the-art techniques for enabling capable agents using efficient and compact LLMs, including model distillation, dynamic routing, and memory- and compute efficient serving, providing a foundation for scalable and responsive agent design under resource constraints. Second, we cover coordination and communication among agents, crucial for collective performance, highlighting methods for improving multi-agent reasoning and decision-making through prompt and graph optimization, sycophancy mitigation, and structured LLM-based frameworks. Last, we explore real-world applications of LLM agents in areas such as industry, healthcare, quantum computing, and various scientific domains.

cs.CL · cs.MA

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.4ACL Anthology · ACL 2026

Current Advances in LLM Reasoning

Akhil Arora Aarhus University, Vishrav Chaudhary Meta, Julia Kreutzer Cohere Labs, Nearchos Potamitis Aarhus University, Nouha Dziri Allen Institute for AI, Niket Tandon Microsoft Research

原文摘要

As large language models (LLMs) increasingly tackle reasoning-heavy tasks, from mathematics to commonsense to multilingual understanding, researchers face three pressing questions: How well do models reason? How can we make them reason better? What are the next frontiers in LLM reasoning? This tutorial answers these questions through a unified view of LLM reasoning. This tutorial explores comprehensive evaluation strategies to assess the reasoning abilities of models and discusses two types of methods to improve models’ reasoning: advanced inference time methods, such as structured and self-improvement inference methods, and (ii) post-training methods, such as RLHF, DPO, and GRPO that aim to make LLMs think more like humans. The tutorial explores these technical discussions while maintaining a practical outlook through illustrative demos and short guided hands-on exercises. The tutorial is designed for both researchers and practitioners seeking practical insights into LLM reasoning.

cs.CL

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.5ACL Anthology · ACL 2026

Knowledge Control for Responsible Generative AI: Bridging Academia, Industry, and Society

Zheyuan Liu University of Notre Dame, Yixin Wan University of California, Los Angeles, Kai-Wei Chang University of California, Los Angeles, Meng Jiang University of Notre Dame, Jieyu Zhao University of Southern California, Nouha Dziri Cohere Labs, Yuning Mao Meta Superintelligence Labs, Jia-Chen Gu University of California, Los Angeles 等 9 位作者

原文摘要

Controlling the knowledge and behavior of generative AI systems, including large language models (LLMs), multimodal LLMs (MLLMs), and text-to-image (T2I) models, has become critical as they are increasingly used in safety-sensitive and socially impactful applications. These models often encode unintended, biased, or private content, leading to harmful or unethical outputs. Post-training knowledge control has thus emerged as a practical framework for selectively modifying or removing model behaviors without full retraining, offering scalable and interpretable interventions for improving safety, privacy, and fairness. This tutorial introduces the foundations of post-training knowledge control and showcases recent frontier methods, bridging research insights with real-world practices from both academia and industry. We cover: (i) key motivations and failure modes, such as harmful generation and stereotype reinforcement; (ii) core methods such as machine unlearning, knowledge editing, and inference-time interventions for targeted behavior adjustment; and (iii) evaluation protocols for balancing forgetting, retention, and fairness. Case studies will span text and vision–language generation, including privacy preservation, bias mitigation, and factual correction.

cs.CL · cs.CV

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1ACL Anthology · ACL 2026:acl:2026.acl-tutorials.6ACL Anthology · ACL 2026

The Interplay between Metaphors and NLP

Joanne Boisson Cardiff University, Jose Camacho-Collados Cardiff University, Elisa Sanchez-Bayona University of the Basque Country, Rodrigo Agerri University of the Basque Country

原文摘要

This tutorial will be of the type Introductory to CL/NLP topics, providing an overview of the metaphor processing field. The tutorial will discuss the influence of various metaphor theories on the creation of annotated resources and models. We will particularly focus on recent directions opened by LLMs for metaphor interpretation in multilingual and multimodal settings. Two types of audience may benefit from this tutorial: researchers in the humanities and computational social sciences interested in automatic or semi automatic metaphor analysis, and NLP researchers interested in understanding metaphor processing and improving metaphor modeling.

cs.CL · cs.CV

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) · 2026 · 正式发表

首次观测 · 记录 #1软件学报:jos:7675软件学报

Int-AD: 面向提示注入攻击的攻防一体化框架

程翔, 曹晟, 陈厅, 李雄, 张小松

原文摘要

提示注入攻击(prompt injection attack)已成为大语言模型(LLM)应用日益严峻的安全威胁, 位于OWASP开放式Web应用程序安全项目10大威胁之首. 此类攻击通过在提示词中嵌入恶意内容来诱导大模型生成误导性输出, 带来信息泄露、系统滥用等严重安全隐患. 然而, 目前针对此类攻击的攻击策略评估指标仅有攻击成功率, 难以全面评估攻击效果; 在防御策略方面, 现有方法通常只能单独用于预防或检测, 两者难以兼得. 深入分析提示注入攻击和防御的特征及其对大模型输出的影响, 提出攻防一体化框架Int-AD, 包括: 采用情感增强和控制输出的提示注入攻击方法CoA (control-output attack)和同时具备预防和检测能力的防御策略UnD (universal defense). 在攻击方面, 定义两个新的攻击评价指标: 攻击干扰率(attack interference rate, AIR)与攻击误导率(attack misdirection rate, AMR), 用于在攻击结果不同时分别进行精准评估, 完善攻击评估指标. 通过情感增强和控制输出设计提示词, 将AIR和AMR与现有METEOR评估指标联合使用来评估CoA的攻击效率; 在防御方面, UnD兼具预防和检测能力, 可提高防御成功率并检测提示注入攻击的影响. 在Qwen、Llama、DeepSeek这3个主流大模型上采用squad和web_questions两个公开数据集进行实验, CoA攻击方法的平均METEOR得分为0.050, 相比当前最好方法Combine可降低42.5%; 平均AIR和AMR分别达到0.97和0.45, 相比Combine分别提升6.59%和28.57%, 表明CoA具有更强的攻击能力. UnD的平均防御成功率达80.6%, 相比当前最好方法Sandwich提高9.07%, 其平均KMR (knownanswer matching rate)为0.921, 较方法Knownanswer提升58.52%, 表明UnD具有更强的防御能力.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

版本更新 · v2arXiv:2502.18864Google Research

Co-Scientist:加速科学发现的多智能体AI系统

Accelerating scientific discovery with Co-Scientist

Juraj Gottweis, Wei-Hung Weng, Alexander Daryin, Tao Tu, Petar Sirkovic, Artiom Myaskovsky, Grzegorz Glowaty, Felix Weissenberger 等 51 位作者

AI 速读 基于摘要

基于Gemini的多智能体系统Co-Scientist通过生成、批判和进化假设,在生物医学领域辅助科学家发现新知识。

cs.AI · cs.CL · cs.HC · cs.LG · q-bio.OT

查看原文摘要

Scientific discovery is driven by scientists generating novel hypotheses for complex problems that undergo rigorous experimental validation. To augment this process, we introduce Co-Scientist, a multi-agent AI system built on Gemini for structured scientific thinking and hypothesis generation. Co-Scientist aims to help scientists discover new original knowledge. Conditioned on their research objectives and prior scientific evidence, it formulates demonstrably novel research hypotheses for experimental verification. The system's design involves agents continuously generating, critiquing and refining hypotheses accelerated by scaling test-time compute. Key contributions include: (1) a multi-agent architecture with an asynchronous task execution framework for flexible compute scaling; (2) a tournament evolution process for self-improving hypotheses generation. Automated evaluations show continued benefits of test-time compute scaling, improving hypothesis quality over time. While general purpose, we focus the validation in three biomedical applications: drug repurposing, novel target discovery, and explaining mechanisms of anti-microbial resistance. Specifically, Co-Scientist helped identify new drug repurposing candidates and synergistic combination therapies for acute myeloid leukemia, which were validated through in vitro experiments. These real-world validations demonstrate the potential of Co-Scientist to accelerate scientific discovery and usher in an era of AI empowered scientists.

新论文 · v1arXiv:2606.28277Google Research

迈向自动化科学评审:谷歌论文助手工具

Towards Automating Scientific Review with Google's Paper Assistant Tool

Rajesh Jayaram, Drew Tyler, David Woodruff, Corinna Cortes, Yossi Matias, Vahab Mirrokni, Vincent Cohen-Addad

AI 速读 基于摘要

提出AI与人类在科学评审中协作的四级分类框架,并介绍用于深度科学评审与验证的智能体框架Paper Assistant Tool(PAT)。

cs.LG · cs.AI · cs.CL · cs.CY

查看原文摘要

Artificial intelligence is driving a revolution in scientific discovery, accelerating everything from hypothesis generation to mathematical theorem proving. However, this rapid acceleration is creating a systemic challenge: traditional human peer review cannot scale to match the influx of AI-assisted science. Ultimately, to resolve this tension, we must also deploy AI to accelerate the verification and review process itself. To frame the discussion around this transition, we propose a taxonomy consisting of four progressive levels of AI-human collaboration in scientific evaluation, and discuss various trade-offs involved with each. As a step toward this future, we introduce the Paper Assistant Tool (PAT), an agentic AI framework built for deep scientific review and verification. PAT ingests full scientific manuscripts and produces a comprehensive evaluation, checking theoretical results, validating experiments, suggesting improvements, and identifying potential flaws. By utilizing inference scaling techniques, PAT is able to identify deeper issues than a single model call alone, achieving a 34% improvement over zero-shot recall on mathematical errors in the SPOT benchmark. Pilot deployments of PAT as a pre-submission tool for authors at two major Computer Science conferences -- STOC and ICML -- demonstrate its ability to identify critical errors and suggest substantive improvements to research papers. By catching errors early, PAT eases the cognitive burden placed on referees, while preserving their control over the outcomes of the review process.

首次观测 · 记录 #1软件学报:jos:7627软件学报

知识图谱推理研究综述: 从单一任务到复杂任务

牛广林, 粟思悦, 李波

原文摘要

知识图谱可以有效组织和利用现实世界中的各类知识, 弥补数据驱动的方法或者大模型技术存在的不可解释和幻觉等不足, 是实现具有理解和推理能力的认知智能系统的核心技术之一. 知识图谱推理是从已有的知识推理出新的知识, 广泛应用于工农业生产、国防安全、日常生活等领域. 早期知识图谱推理领域主要关注单一推理任务, 近3年逐渐开始关注更加复杂的推理任务, 包括时序多步知识图谱推理、小样本多步知识图谱推理、小样本时序知识图谱推理、小样本多模态知识图谱推理、多模态归纳式知识图谱推理和时序归纳式知识图谱推理. 为此, 首先分别描述面向单一任务和复杂任务的知识图谱推理的特点, 进而, 介绍几类面向单一任务的知识图谱推理技术. 然后系统总结面向复杂任务的已有代表性知识图谱推理方法, 并对这些方法进行对比分析. 最后, 总结和探讨当前知识图谱推理仍存在的主要问题, 并对该领域有价值的未来发展方向进行展望.

cs.* · cs.CL · cs.CV

软件学报 · 2026 · 正式发表

首次观测 · 记录 #1软件学报:jos:7684软件学报

面向大语言模型生成能力提升的检索增强生成研究进展

刘澳迪, 奚雪峰, 周国栋

原文摘要

随着深度学习和Transformer架构的不断发展, 基于大语言模型的自然语言处理任务取得了显著进展, 但依然存在着认知幻觉、信息滞后和专业领域知识缺乏等问题. 为解决这些问题, 通过引入外部知识库的检索机制, 检索增强生成技术使模型不仅借助已有的知识, 还能实时检索外部数据, 从而提高生成内容的准确性、时效性及适应性. 本文探讨了检索增强生成技术在提升大语言模型生成能力中的作用. 首先, 从检索增强和增强生成两个方面, 对不同检索目标的检索方法及增强生成的多种技术路径进行系统性分类; 随后, 分析总结检索增强生成技术的原理、实现方式以及其在多个领域的应用; 最后, 在多个领域探讨检索增强生成技术已有的应用成效、面临的挑战及未来的发展前景.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

版本更新 · v2arXiv:2602.14080Google Research

Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factuality

Nitay Calderon, Eyal Ben-David, Zorik Gekhman, Eran Ofek, Gal Yona

原文摘要

Standard factuality evaluations of LLMs treat all errors alike, obscuring whether failures arise from missing knowledge (empty shelves) or from limited access to encoded facts (lost keys). We propose a behavioral framework that profiles factual knowledge at the level of facts rather than questions, characterizing each fact by whether it is encoded, and then by how accessible it is: cannot be recalled, can be directly recalled, or can only be recalled with inference-time computation (thinking). To support such profiling, we introduce WikiProfile, a new benchmark constructed via an automated pipeline with a prompted LLM grounded in web search. Across 4 million responses from 13 LLMs, we find that encoding is nearly saturated in frontier models on our benchmark, with GPT-5 and Gemini-3 encoding 95--98% of facts. However, recall remains a major bottleneck: many errors previously attributed to missing knowledge instead stem from failures to access it. These failures are systematic and disproportionately affect long-tail facts and reverse questions. Finally, we show that thinking improves recall and can recover a substantial fraction of failures, indicating that future gains may rely less on scaling and more on methods that improve how models utilize what they already encode.

cs.CL · cs.AI

版本更新 · v3arXiv:2508.04086Google Research

ToolGrad:利用文本“梯度”高效生成工具使用数据集

ToolGrad: Efficient Tool-use Dataset Generation with Textual "Gradients"

Zhongyi Zhou, Kohei Uehara, Haoyu Zhang, Jingtao Zhou, Lin Gu, Ruofei Du, Zheng Xu, Tatsuya Harada

AI 速读 基于摘要

ToolGrad 提出“先答案后问题”的智能体框架,通过文本“梯度”迭代构造有效工具调用链,再反向合成用户查询,从而低成本生成高质量工具使用数据集。

cs.CL

查看原文摘要

Prior work synthesizes tool-use LLM datasets by first generating a user query, followed by complex tool-use annotations like depth-first search (DFS). This leads to inevitable annotation failures and low efficiency in data generation. We introduce ToolGrad, an agentic framework that inverts this paradigm. ToolGrad first constructs valid tool-use chains through an iterative process guided by textual "gradients", and then synthesizes corresponding user queries. This "answer-first" approach led to ToolGrad-500, a dataset generated with more complex tool use, lower cost, and almost 100% pass rate. Experiments show that ToolGrad models outperform those trained on expensive baseline datasets and proprietary LLMs. The ToolGrad source code, dataset, and models are available at https://github.com/zhongyi-zhou/toolgrad.

首次观测 · 记录 #1软件学报:jos:7659软件学报

QueryGuide: 基于生成式模型的细粒度查询提示推荐方法

杨少聪, 王宁

原文摘要

慢查询是指执行时间超过数据库系统所设定的阈值, 从而影响整体性能的查询. 由于开发人员经验不足及查询接口模板缺乏灵活性, 慢查询在应用程序中频繁出现, 成为数据库故障的主要原因. 为了提速慢查询, 数据库管理员通常会进行人工修复, 但是在数据量较大的情况下效率较低, 因此针对慢查询的自动重写方法的研究显得尤为重要. 查询提示是用于显式控制数据库优化器决策的调优指令, 可以通过影响访问路径等策略来改善查询性能. 查询提示推荐作为数据库查询重写领域的重要研究问题, 已经得到广泛关注. 然而, 目前基于机器学习的提示推荐方法仍面临粒度较粗、依赖人工指定候选集等问题. 针对这些问题, 提出基于生成式模型的细粒度提示推荐框架QueryGuide, 通过探索不同细粒度提示的最优组合方式, 来提升重写语句的物理计划执行效率. 具体而言, 该框架一方面基于生成式语言模型探寻推荐策略, 在数据库环境中探索提示对慢查询性能的提升, 并将其作为奖励用于模型微调, 从而生成表级别的细粒度提示; 另一方面提出使用生成式模型推荐的细粒度提示作为探索方向, 并通过扩展得到提示组合. 将组合的探索结果用于模型微调, 可以使模型学习不同提示组合对慢查询重写性能的影响, 从而获得最佳提示组合. 在多个数据集上的实验结果表明, 相较于其他基线算法, QueryGuide方法表现出更好的重写性能, 显著改善了查询时间.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

版本更新 · v2arXiv:2512.20111Berkeley BAIR

ABBEL:学习自然语言信念状态以实现内存高效交互

ABBEL: Learning Natural-Language Belief States for Memory-Efficient Interaction

Aly Lidayan, Jakob Bjorner, Satvik Golechha, Kartik Goyal, Alane Suhr

AI 速读 基于摘要

ABBEL 通过显式自然语言信念状态和强化学习微调,提升递归摘要记忆代理的性能并降低内存占用。

cs.CL · cs.AI · cs.LG

查看原文摘要

As the time horizons of sequential decision-making tasks grow, keeping full interaction histories in model context becomes increasingly costly. Recent work reduces context lengths by instead conditioning decision-making agents on recursively updated natural-language summaries, which are concise and interpretable. However, they underperform agents with access to the full context, suggesting that they fail to generate sufficient summaries. To address this we propose ABBEL, a recursive summarization framework that isolates and directly supervises each summary's information contents in the form of explicit natural-language belief states. First, we analyze the belief states generated by frontier models under ABBEL across five domains, and verify that performance is often degraded due to omitting or incorrectly updating information. We also discover settings where models use memory inefficiently by retaining extraneous information. We target these limitations by fine-tuning with two RL-based methods: belief grading, which reduces update errors by rewarding belief generations based on their information content, and peak belief penalties, which encourage compressing the beliefs with the greatest memory footprints. We demonstrate that these methods significantly reduce the performance gap with full context models, and enable ABBEL to outperform prior memory agent work by 40% while using 67% of the memory. Our code is available at https://github.com/jakob-bjorner/optimal-explorer-dev

首次观测 · 记录 #1软件学报:jos:7663软件学报

基于LLM智能体的智能家居场景规则自动生成

刘力玮, 陈伟, 魏峻, 朱家鑫, 王伟, 吴国全, 汪涛

原文摘要

在智能家居系统中, 场景自动化规则可根据用户设定的触发条件, 自动执行一组设备操作, 实现如“回家模式”“睡眠模式”等复杂的设备联动行为. 然而, 终端用户在创建定制化规则时常面临挑战, 特别是在实现多设备协同和满足复杂用户意图时表现尤为明显. 一方面, 用户普遍缺乏专业知识, 难以清晰表达需求或将其转化为形式化规则; 另一方面, 现有自动化规则生成方法普遍存在两方面局限: 其一, 缺乏对复杂场景的建模能力, 难以支持涉及多设备协同的高级自动化需求; 其二, 过于依赖用户提供明确的、结构化的指令, 忽略了用户意图的隐性表达. 为解决上述问题, 提出HomeMind——以大语言模型(large language model, LLM)为核心, 融合模式挖掘与语义理解能力的智能体系统. HomeMind的工作流程包括3个核心步骤: 首先, 采用无监督的频繁事件模式挖掘方法, 自适应处理不同长度的事件序列, 以更精准地识别事件模式; 其次, 为每个模式提取周与日两个尺度的时间特征, 显著增强其时间上下文信息; 最后, 通过上下文增强的提示词机制, 引导LLM基于思维链推断用户意图, 生成语义明确的场景规则. 最终, HomeMind将生成的候选规则呈现给用户, 辅助其理解并筛选最契合生活习惯的自动化方案, 并支持与智能家居平台接口集成, 实现规则一键部署. 在真实世界数据集和合成数据集上对HomeMind进行全面评估, 实验结果表明其在意图推断和规则生成准确性方面均优于现有基线方法.

cs.* · cs.CL · cs.AI

软件学报 · 2026 · 正式发表

新论文 · v1arXiv:2605.26340Google Research

ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence

Rui Meng, Bhavana Dalvi Mishra, Jiefeng Chen, Chun-Liang Li, Palash Goyal, Mihir Parmar, Yiwen Song, Yale Song 等 13 位作者

原文摘要

Autonomous research agents produce competitive solutions and professional-looking manuscripts, yet their outputs contain verifiability failures undetectable by surface-level evaluation: fabricated citations, unreproducible scores, and method descriptions that diverge from the implementation. We address this through three contributions. First, Chain-of-Evidence (CoE), a verifiability framework requiring every claim to be traceable to its evidence source. Second, ScientistOne, an end-to-end autonomous research system that maintains evidence chains by construction throughout literature review, solution discovery, and paper writing. Third, CoE Audit, a post-hoc audit whose four integrity checks -- score verification, specification violation, reference verification, and method-code alignment -- apply uniformly to all systems. Across 75 papers spanning five systems and five frontier research tasks, every baseline exhibits at least one systematic failure mode: hallucinated reference rates reach 21%, score verification passes in as few as 42% of papers, and method-code alignment ranges from 20% to 80%. ScientistOne achieves zero hallucinated references (0/337), perfect score verification (12/12), and the highest method-code alignment (14/15), while matching or exceeding human expert performance on all five tasks. ScientistOne further generalizes to six additional tasks spanning medical imaging, fine-grained recognition, 3D perception, and language modeling, achieving state-of-the-art on Parameter Golf and gold medals on MLE-Bench tasks where baselines fail entirely.

cs.AI · cs.CL · cs.MA

新论文 · v1arXiv:2605.16191Google Research

Optimized Three-Dimensional Photovoltaic Structures with LLM guided Tree Search

Michael P. Brenner, Lizzie Dorfman, John C. Platt

原文摘要

We present a case study for how AI coding systems can be used to generate novel scientific hypotheses. We combine a generic coding agent (Google's AntiGravity) with an LLM-driven tree search algorithm (Empirical Research Assistance / ERA) to autonomously generate high-efficiency three-dimensional photovoltaic (3DPV) structures that overcome losses limiting flat solar panels at mid-latitudes. These structures operate by presenting favorable angles to the sun throughout the day, and for illustrative purposes we focus on optimizing performance for a single solar day. Our workflow begins by using AntiGravity to reproduce calculations \cite{bernardi2012solar} showing that 3DPV can have energy densities much higher than stationary flat PV panels. We use these initial designs as the starting point for large scale tree search, where we seek improved solutions and score them for their diurnal yield. The initial tree search leads to nominally more efficient solutions, yet they are caused by algorithmic reward hacking, arising from non-physical design features such as structurally levitating disconnected tiers and exploitations of the discretizations in the optics solver. To counteract this, we develop a workflow where the coding agent iteratively patches the physics engine with constraints to eliminate reward hacking. With reward-hacking eliminated, ERA discovers a series of designs with various constraints and improved performance, including optimal designs with different fixed collector areas, optimizing zenith tracking and avoiding self shadowing. Combining coding agents with tree search (ERA) provides a powerful platform for scientific discovery, for problems whose solutions can be empirically evaluated with a score function.

cs.CL · cond-mat.other · physics.comp-ph

首次观测 · 记录 #1软件学报:jos:7635软件学报

ToxiHeap: LLM制导和毒性标记的JavaScript引擎模糊测试框架

沙乐天, 龙章伯, 丁加宇, 黄海平, 肖甫

原文摘要

现有浏览器JavaScript引擎模糊测试工具在检测潜在漏洞方面仍存在局限, 尤其对不触发崩溃的堆内存错误识别能力不足. 为此, 提出ToxiHeap, 一种将内存毒性标记(toxic labeling)的运行时监测和大语言模型(large language model, LLM)制导语义生成, 设计为并行核心轨道的JavaScript引擎模糊测试框架. 检测轨在目标引擎的堆分配与访问路径上插桩, 通过影子内存与细粒度毒性标记统一刻画释放后使用(use-after-free, UAF)、double free、堆越界读写(out-of-bounds read/write,OOB-R/W)、内存泄漏(memory leak)和未初始化堆内存读(uninitialized memory read,UMR)等多类堆错误, 并将对已释放内存等非法状态的访问转化为可消费的异常信号, 弥补传统依赖崩溃信号方法对非崩溃漏洞缺乏有效检测信号的不足; 生成轨采用“蒸馏-激励”两阶段的LLM变异器, 从历史PoC中提炼语义特征并定向构造状态依赖的测试用例, 突破仅依赖语法或轻语义变异在深路径覆盖上的局限. 两条轨道以覆盖增益和非崩溃命中信号在反馈环路中汇合, 协同驱动样本保留、路径权重更新和知识库自增, 同时引入隔离重放验证机制, 在干净进程中二次确认异常, 显著降低非确定性误报. 实验结果表明, 在JavaScriptCore (JSC)引擎上, ToxiHeap在24 h运行下的分支覆盖率由31.17%提升至33.52%, 在V8、SpiderMonkey (SM)和ChakraCore (CH)等其他主流引擎上同样取得了最高或接近最高的分支覆盖率, 有效样本占比稳定在91%以上. 在覆盖UAF等多类缺陷模式的50条PoC参考集上, 4个引擎综合平均的整体检出率达到89.18%.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

版本更新 · v3arXiv:2512.24601Berkeley BAIR

递归语言模型

Recursive Language Models

Alex L. Zhang, Tim Kraska, Omar Khattab

AI 速读 基于摘要

提出递归语言模型(RLM)推理范式,让 LLM 把超长提示当作外部环境,通过编程式检查、分解并递归调用自身来处理远超上下文窗口的输入。

cs.AI · cs.CL

查看原文摘要

We study allowing large language models (LLMs) to process arbitrarily long prompts through the lens of inference-time scaling. We propose Recursive Language Models (RLMs), a general inference paradigm that treats long prompts as part of an external environment and allows the LLM to programmatically examine, decompose, and recursively call itself over snippets of the prompt. We find that RLMs can successfully process inputs up to two orders of magnitude beyond model context windows and, even for shorter prompts, dramatically outperform the quality of vanilla frontier LLMs and common long-context and coding scaffolds (e.g., on GPT-5 by a median across the evaluated benchmarks of $26\%$ against compaction, $130\%$ against CodeAct with sub-calls, and $13\%$ against Claude Code) across four diverse long-context tasks while having comparable cost. At a small scale, we post-train the first model around the RLM. Our model, RLM-Qwen3-8B, outperforms the underlying Qwen3-8B model by $28.3\%$ on average and even approaches the quality of vanilla GPT-5 on three long-context tasks. Code is available at https://github.com/alexzhang13/rlm.

版本更新 · v3arXiv:2406.12708Google Research

AgentReview: Exploring Peer Review Dynamics with LLM Agents

Yiqiao Jin, Qinlin Zhao, Yiyang Wang, Hao Chen, Kaijie Zhu, Yijia Xiao, Jindong Wang

原文摘要

Peer review is fundamental to the integrity and advancement of scientific publication. Traditional methods of peer review analyses often rely on exploration and statistics of existing peer review data, which do not adequately address the multivariate nature of the process, account for the latent variables, and are further constrained by privacy concerns due to the sensitive nature of the data. We introduce AgentReview, the first large language model (LLM) based peer review simulation framework, which effectively disentangles the impacts of multiple latent factors and addresses the privacy issue. Our study reveals significant insights, including a notable 37.1% variation in paper decisions due to reviewers' biases, supported by sociological theories such as the social influence theory, altruism fatigue, and authority bias. We believe that this study could offer valuable insights to improve the design of peer review mechanisms. Our code is available at https://github.com/Ahren09/AgentReview.

cs.CL

版本更新 · v2arXiv:2605.04665Google Research

改写引发的输出模式崩溃:当大语言模型在语义等价输入下脱离角色

Paraphrase-Induced Output-Mode Collapse: When LLMs Break Character Under Semantically Equivalent Inputs

Aofan Liu, Jingxiang Meng

AI 速读 基于摘要

作者报告,语义等价但措辞不同的提示改写会让大语言模型放弃原本要求的封闭式输出格式,转而输出对话式散文,从而在精确匹配评测中被误判。

cs.CL

查看原文摘要

When the substantive content of a request is rewritten, do large language models still answer in the format the original task asked for? We find that they often do not, even at temperature zero. On a 150-query evaluation over five compact 2025-era LLMs and four task types, we observe a systematic failure mode we call prompt-variant output-mode collapse: when a closed-form prompt asks for a bare label or a single choice token, content-preserving prompt variants can push the model into conversational prose, the requested format dissolves, and exact-match evaluation pipelines silently misjudge the result. To make this measurable, we release PARACONSIST, a 900-prompt benchmark of 150 base queries with five lexical, syntactic, and semantic-expansion prompt variants each, and a Semantic Consistency Score that decomposes prompt-variant robustness into answer consistency, sentence-BERT semantic similarity, and length stability. Under a whole-word answer-set match, only ~22% of closed-form variant responses preserve the ground-truth label inside their output, while ~78% drift away from the answer space entirely. In our pool, the dominant predictor of collapse is task structure rather than model identity, with model differentiation jointly carried by answer consistency and length stability. Robustness audits should therefore track response-mode preservation as a first-class reliability target alongside answer accuracy.

新论文 · v1arXiv:2604.21428Google DeepMind

Decoupled DiLoCo for Resilient Distributed Pre-training

Arthur Douillard, Keith Rush, Yani Donchev, Zachary Charles, Nova Fallen, Ayush Dubey, Ionel Gog, Josef Dean 等 17 位作者

原文摘要

Modern large-scale language model pre-training relies heavily on the single program multiple data (SPMD) paradigm, which requires tight coupling across accelerators. Due to this coupling, transient slowdowns, hardware failures, and synchronization overhead stall the entire computation, wasting significant compute time at scale. While recent distributed methods like DiLoCo reduced communication bandwidth, they remained fundamentally synchronous and vulnerable to these system stalls. To address this, we introduce Decoupled DiLoCo, an evolution of the DiLoCo framework designed to break the lock-step synchronization barrier and go beyond SPMD to maximize training goodput. Decoupled DiLoCo partitions compute across multiple independent ``learners'' that execute local inner optimization steps. These learners asynchronously communicate parameter fragments to a central synchronizer, which circumvents failed or straggling learners by aggregating updates using a minimum quorum, an adaptive grace window, and dynamic token-weighted merging. Inspired by ``chaos engineering'', we achieve significantly improved training efficiency in failure-prone environments with millions of simulated chips with strictly zero global downtime, while maintaining competitive model performance across text and vision tasks, for both dense and mixture-of-expert architectures.

cs.CL

新论文 · v1arXiv:2604.19292Google Research

Location Not Found: Exposing Implicit Local and Global Biases in Multilingual LLMs

Guy Mor-Lan, Omer Goldman, Matan Eyal, Adi Mayrav Gilady, Sivan Eiger, Idan Szpektor, Avinatan Hassidim, Yossi Matias 等 9 位作者

原文摘要

Multilingual large language models (LLMs) have minimized the fluency gap between languages. This advancement, however, exposes models to the risk of biased behavior, as knowledge and norms may propagate across languages. In this work, we aim to quantify models' inter- and intra-lingual biases, via their ability to answer locale-ambiguous questions. To this end, we present LocQA, a test set containing 2,156 questions in 12 languages, referring to various locale-dependent facts such as laws, dates, and measurements. The questions do not contain indications of the locales they relate to, other than the querying language itself. LLMs' responses to LocQA locale-ambiguous questions thus reveal models' implicit priors. We used LocQA to evaluate 32 models, and detected two types of structural biases. Inter-lingually, we show a global bias towards answers relevant to the US-locale, even when models are asked in languages other than English. Moreover, we discovered that this global bias is exacerbated in models that underwent instruction tuning, compared to their base counterparts. Intra-lingually, we show that when multiple locales are relevant for the same language, models act as demographic probability engines, prioritizing locales with larger populations. Taken together, insights from LocQA may help in shaping LLMs' desired local behavior, and in quantifying the impact of various training phases on different kinds of biases.

cs.CL · cs.AI

新论文 · v1arXiv:2604.13452Google Research

CANVAS:通过视觉智能体分镜实现连续性感知叙事

CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding

Ishani Mondal, Yiwen Song, Mihir Parmar, Palash Goyal, Jordan Boyd-Graber, Tomas Pfister, Yale Song

AI 速读 基于摘要

CANVAS 是一个多智能体框架,通过显式规划角色、背景与场景转换的连续性,来生成多镜头长篇视觉故事分镜。

cs.CL

查看原文摘要

Long-form visual storytelling requires maintaining continuity across shots, including consistent characters, stable environments, and smooth scene transitions. While existing generative models can produce strong individual frames, they fail to preserve such continuity, leading to appearance changes, inconsistent backgrounds, and abrupt scene shifts. We introduce CANVAS (Continuity-Aware Narratives via Visual Agentic Storyboarding), a multi-agent framework that explicitly plans visual continuity in multi-shot narratives. CANVAS enforces coherence through character continuity, persistent background anchors, and location-aware scene planning for smooth transitions within the same setting We evaluate CANVAS on two storyboard generation benchmarks ST-BENCH and ViStoryBench and introduce a new challenging benchmark HardContinuityBench for long-range narrative consistency. CANVAS consistently outperforms the best-performing baseline, improving background continuity by 21.6%, character consistency by 9.6% and props consistency by 7.6%.