跳到正文
研踪PaperTrail

YOUR RESEARCH, IN SIGHT

让下一篇重要论文,不再错过。

覆盖计算机全学科,以 AI 为快捷入口。关注方向、作者和关键词,把发现变成持续的研究积累。

部分采集异常
正在读取账号与研究记录…

全站更新概况

+2471新增论文
+2025其中 AI 相关
+163已有论文修订
+100新增 AI 导读

arXiv 最近完成扫描:2026-11-11 00:48 · 全站最近入库:2026-11-10 15:22各信源进度 →

统计口径与数据新鲜度

统计 2026-11-10 01:17 — 2026-11-11 01:17(北京时间) · 点击数字查看对应简报;AI 相关包含在新增论文内。

最近完成检查:2026-11-11 00:48最近发现新增版本:2026-11-10 15:22库内论文最新更新时间:2026-11-10 02:59

每分钟刷新已保存的数据。空检查不代表采集异常;新收录可能包含历史论文。AI 导读按新增版本计数。

20,643 已收录论文17,531 AI 相关5,643 有修订112 HF 社区发现

浏览论文库

时间范围跟随排序:版本更新、本站收录或首次发表。最新收录可能包含历史论文。部分信源异常,查看状态 →

找到 20,643 篇论文 · 按版本更新时间排序上轮扫描起点 2026-11-11 00:46(北京时间)
版本更新 · v2arXiv:2610.18726Apple ML Research

通过语音基础模型中的语言选择性维度进行语码转换检测

Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models

Jie Chi, Zakaria Aldeneh, Masha Fedzechkina, Maureen de Seyssel, Natalie Schluter

AI 速读 基于摘要

利用预训练语音编码器中语言选择性的隐状态维度,直接从语音帧级激活判断一句话内是否出现语码转换。

cs.CL

查看原文摘要

Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding relevant utterances in large speech collections so that they can be included in training data. One way to find such utterances is to transcribe the speech and detect language alternation in the text, but this depends on obtaining accurate multilingual transcriptions. We propose a lightweight method that detects CS directly from speech. It uses frame-level language information in pretrained speech encoders to determine whether both languages are present within an utterance. Specifically, we identify language-selective hidden-state dimensions using monolingual recordings and aggregate their frame-level activations into a CS prediction. With a small CS set used to tune a decision rule, we show that the Whisper-small encoder achieves a mean F1 of $0.798$ across 14 language pairs in CS-FLEURS, compared with $0.776$ for a CNN and $0.751$ for a HuBERT linear baseline trained for monolingual language identification. Our findings suggest that pretrained speech encoders already encode the information needed to identify CS utterances, and they provide a lightweight tool for building more representative multilingual corpora.

新论文 · v1arXiv:2610.20832HF 社区推荐

Amortizing Sequential Experimental Design in Reasoning LLMs

Anita Kriz, Antonin Berthon, Nicolás Astorga, Mihaela van der Schaar

原文摘要

Despite their extensive pretraining knowledge and strong reasoning capabilities, large language models (LLMs) struggle to adaptively gather information in experimental design tasks. We study how to amortize sequential Bayesian experimental design (BED) into an LLM by explicitly training the reasoning that guides action selection using information-gain rewards. Our approach specifies the experimental generative model independently of the LLM's own beliefs, allowing us to optimize expected information gain under a model of our choosing. We investigate the design choices for amortization, including alternative generative-model constructions, reward estimation, hypothesis-space specification, multi-step objectives, and computational costs relative to training- and inference-time BED baselines. On Twenty Questions, the resulting policies improve information acquisition and task performance, outperform inference- and training-time BED baselines at substantially lower computational cost, and generalize to unseen categories. We further demonstrate positive transfer from Twenty Questions training to Medi-Q, a real-world clinical dialogue benchmark. These results suggest that information gathering can be learned as a generalizable reasoning skill in LLMs.

cs.LG · cs.AI

版本更新 · v2arXiv:2605.16238Google Research

Prospective multi-pathogen disease forecasting using autonomous LLM-guided tree search

Sarah Martinson, Michael P. Brenner, Martyna Plomecka, Brian P. Williams, Nicholas G. Reich, Zahra Shamsi

原文摘要

Probabilistic forecasting of infectious diseases is crucial for public health monitoring and preparedness but has historically relied on labor-intensive manual model curation by expert modeling teams. Bespoke development is an obstacle to scaling models to granular geographic resolutions or emerging pathogens. Here, we prospectively evaluate Empirical Research Assistance (ERA), an autonomous system that uses Large Language Model-guided tree search to iteratively generate, evaluate, and optimize executable forecasting software. ERA was primarily prompted with methodological approaches to implement, while in some instances it was tasked with developing forecasting approaches from scratch. In a fully prospective, real-time evaluation during the 2025-26 United States respiratory season, ERA generated methodologically diverse models for influenza, COVID-19, and respiratory syncytial virus (RSV). Aggregating a selection of these automatically-generated models yielded an ensemble that ranked first overall in official Centers for Disease Control and Prevention (CDC) post-season evaluations and outperformed the gold-standard CDC forecast ensembles across all three pathogens in a real-time prediction challenge. Additionally, ERA successfully navigated data-scarce scenarios for RSV. Controlled retrospective ablations allowed for additional explorations of the impact of optimization target and instruction-following on forecast accuracy. Preliminary experiments indicate that ERA's search optimization metric influences behavior of output forecasts, and using higher-tier language models in-search improves predictive performance. By autonomously generating interpretable code that creates epidemiologically relevant predictions, this framework provides a path toward rapidly scaling high-quality disease forecasting.

cs.AI

版本更新 · v2arXiv:2610.18835Berkeley BAIR

RoboSimStudio: An Interactive Toolkit for Human and Agent Rapid Real2Sim of Robot Manipulation Tasks

Kaiyuan Chen, Shuangyu Xie, Uksang Yoo, Xinyue Zhu, Cael Magner, Alvin Zhu, Daehwa Kim, Eric Heiden 等 12 位作者

原文摘要

It has been difficult to accurately model the physics of the interaction between a robot and the objects it manipulates, including contact mechanics, coupled contact dynamics, deformations, stiffness and friction. We present RoboSimStudio (RSS), an interactive toolkit that makes choices of solver, contact model, and physical parameters explicit and editable, allowing both humans and coding agents to quickly create and iteratively refine simulations based on observed physical behavior. We implement RSS with the open Newton physics simulation system and describe experiments with human-guided real2sim using (1) visual evaluation, (2) force-feedback and (3) agentic Real2Sim2Real. Code, video and additional information can be found on the project website: https://robosimstudio.github.io

cs.RO · cs.AI · cs.GR · cs.LG

首次观测 · 记录 #1软件学报:jos:7751软件学报

DiffuCD: 面向扩散语言模型的高效对比解码

李佳, 张奕彤, 金芝

原文摘要

当前主流大语言模型大多采用自回归生成范式, 需要逐token生成文本, 难以满足实际应用对高效推理的需求. 扩散语言模型通过迭代去噪实现并行解码, 在推理效率上具有一定理论优势, 因而被视为提升大语言模型推理效率的一条重要技术路径. 然而, 现有扩散语言模型的生成质量仍有较大提升空间. 对比解码是一种被广泛证明有效的提升语言模型生成质量的方法, 其核心思想是利用能力较弱的业余分布对能力较强的专家分布进行校正. 然而, 现有对比解码方法主要面向自回归语言模型设计, 通常需要额外引入模型来提供业余分布, 这会显著增加推理开销, 削弱扩散语言模型高效推理的核心优势. 为此, 提出一种面向扩散语言模型的高效对比解码方法DiffuCD. 该方法基于一个关键观察: 在扩散语言模型的去噪过程中, 早期时间步由于可利用的上下文信息有限, 预测质量较低; 随着去噪推进, 预测质量逐步提升. 这一特性天然满足对比解码对分布强弱差异的要求. 基于此, DiffuCD直接将历史时间步的预测分布作为业余分布, 将当前时间步的预测分布作为专家分布, 从而对当前分布进行校正. 在4个扩散语言模型和6个评估基准上进行广泛实验. 实验结果表明, DiffuCD能够在多种模型和任务上稳定提升模型生成质量, 并且在吞吐量和峰值显存占用方面与未使用对比解码的对比方法几乎一致, 较好地保留了扩散语言模型高效推理的理论优势.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

新论文 · v1arXiv:2610.19068Apple ML Research

先规划还是先检索?工具发现架构的规模研究

Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

Mingfei Zhang, Amit Surana, Ziauddin Majid, Chenxi Wang, Michael Xu

AI 速读 基于摘要

在ToolBench上系统比较Retrieve-then-Plan与Plan-then-Retrieve两种工具发现范式,发现二者优劣随查询复杂度呈现交叉。

cs.AI · cs.IR

查看原文摘要

Tool-augmented LLM agents discover relevant APIs from large registries before planning execution, yet finite context windows prohibit injecting all tool definitions into a single prompt. The dominant approach, which we term Retrieve-then-Plan (RtP), embeds the user query and retrieves similar tools via approximate nearest-neighbor search. We study an alternative Plan-then-Retrieve (PtR) paradigm in which the LLM first generates Abstract Tool Stubs (hypothesized function signatures describing needed capabilities) which then serve as retrieval queries against the registry. Evaluating on ToolBench (46,984 unique API endpoints, 50 categories) across single-tool (G1), intra-category multi-tool (G2), and cross-category multi-tool (G3) query subsets, we find a clear complexity-dependent crossover: RtP outperforms PtR on single-tool queries while PtR outperforms RtP on multi-tool queries. This crossover holds at every retrieval budget (k=1 to 20), is robust across registry sizes from 1k to 47k APIs, and is consistent across model families (Gemini 2.5 Flash and gpt-oss-120b). We characterize a stub-hallucination failure mode (the LLM invents plausible but non-existent API names) that acts as a double-edged sword: on simple queries PtR's stubs abstract away proper-noun signals that RtP matches directly, yet on complex queries the same mechanism decomposes multi-faceted intent into functional sub-needs. We further analyze token overhead and show that PtR's extra discovery call roughly doubles inference cost, which pays off on multi-tool queries but hurts on single-tool ones, motivating complexity-adaptive routing as a practical direction, one that can be driven by a zero-cost signal already present in the pipeline (RtP's top-1 retrieval score).

新论文 · v1arXiv:2610.19025HF 社区推荐

How Far Can Coding Agents Go in Visual Generation?

Hengguang Zhou, Yuanhao Ban, Jiaqi Feng, Xiaohuan Pei, Justin Cui, Cho-Jui Hsieh

原文摘要

Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.

cs.CV · cs.LG

版本更新 · v3arXiv:2609.40134Berkeley BAIR

Tactile Curiosity Drives Robot Interaction

Klemens Iten, Alexander Proshkin, Bhavya Sukhija, Stelian Coros, Andreas Krause, Pieter Abbeel, Carmelo Sferrazza

原文摘要

Mastering robot manipulation skills via reinforcement learning (RL) remains largely sample-inefficient. The most common RL algorithms rely on random action sampling to discover new strategies, resulting in agents that allocate most of their training budget to motions in free space, away from the contacts from which manipulation skills emerge. Existing intrinsic motivation methods based on model disagreement or epistemic uncertainty improve on isotropic noise, but they can also reward uncertainty in functionally irrelevant transitions, such as erratic motions in free space. In this work, we argue that tactile feedback provides a natural signal for exploration, and introduce TacEx, a framework that incorporates touch into epistemic uncertainty-driven exploration by decomposing model uncertainty across sensory modalities and directing curiosity toward the tactile channel. By anchoring curiosity to the sense of touch, TacEx drives the robot to discover complex contact dynamics, learning to manipulate and grasp objects without task rewards or expert demonstrations during exploration. The interaction-dense dataset collected through this tactile-driven curiosity supports offline learning of downstream pick-and-place policies without additional environment interaction. We further use tactile-driven exploration to post-train vision-language-action (VLA) models. Although the VLAs are initially pre-trained without tactile feedback, post-training with TacEx substantially improves downstream performance while remaining highly sample-efficient.

cs.RO · cs.AI

版本更新 · v2arXiv:2602.02481Berkeley BAIR

Flow Policy Gradients for Robot Control

Brent Yi, Hongsuk Choi, Himanshu Gaurav Singh, Xiaoyu Huang, Takara E. Truong, Carmelo Sferrazza, Yi Ma, Rocky Duan 等 12 位作者

原文摘要

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like Gaussians. In this work, we show how flow matching policy gradients, a recent framework that bypasses likelihood computation, can be made effective for training and finetuning more expressive policies in challenging robot control settings. We introduce an improved objective that enables success in legged locomotion, humanoid motion tracking, and manipulation tasks, as well as robust sim-to-real transfer on two humanoid robots. We then present ablations and analysis on training dynamics. Results show how policies can exploit the flow representation for exploration when training from scratch, as well as improved finetuning robustness over baselines.

cs.RO · cs.AI

新论文 · v1arXiv:2610.17927Berkeley BAIR

GLST: Global-Local Spatio-Temporal Memory Decomposition Framework for Online Chained-Goal Navigation

Yousef Liang, Ryan Ardalan, Yarden Goraly, Chenhao Zhu, Yue Yin, Jonas Frey, Claire Tomlin, Marco Pavone 等 9 位作者

原文摘要

Autonomous navigation in real-world environments often requires long-horizon operation under partial observability and evolving goals. Existing mapless navigation approaches predominantly assume fixed goals throughout an episode, limiting applicability to practical scenarios where goals change online during execution. We study online chained-goal navigation, where goals evolve through existing-goal redirection or new-goal emergence without explicit transition signals. Under this setting, we find navigation may require either continued exploration or strategic revisitation, creating conflicting memory requirements. We propose Global-Local Spatio-Temporal Belief Learning (GLST), a memory-decomposition framework that separates latent beliefs into global-local spatial and long-short temporal representations for long-horizon reasoning. We further introduce goal-conditioned rewards to balance exploration and exploitation under evolving goals. Extensive experiments in simulation across diverse terrains demonstrate improved chained-goal navigation performance over baselines. Real-robot experiments using the Spot quadruped further validate our memory decomposition framework.

cs.RO · cs.AI

新论文 · v1arXiv:2610.15750Google Research

Google Earth AI 地理空间推理智能体:能力与系统性评估

Google Earth AI Geospatial Reasoning Agent: Capabilities and a Systematic Evaluation

Noam Slonim, Aviv Slobodkin, Gil Fidel, Gal Moshitch, Mimi Sun, Lily Mihalkova, Joydeep Paul, Per Bjornsson 等 37 位作者

AI 速读 基于摘要

介绍由 Gemini 驱动的 Google Earth AI 地理空间推理智能体 GRA,并发布两个基准,系统评估其工具与智能体编排的贡献。

cs.AI

查看原文摘要

Google Earth AI is a family of geospatial AI models, together with an agent that orchestrates them. We present this agent, Google Earth AI's Geospatial Reasoning agent (GRA), a Gemini-powered research system that combines geospatial data sources, foundation models, and tools to answer questions about our planet. GRA organizes these into modular domain skills and pairs them with upfront geospatial planning to decompose complex queries into multi-stage workflows. Evaluating such systems is hard: real-world problems admit multiple valid workflows, require data discovery across large catalogs, and rely on evolving ground truth. We introduce two benchmarks and release their development splits. GeoExpertQueries poses complex analytical problems grounded in practitioner use cases and refined by geospatial experts; each is paired with a consensus golden workflow from three independent experts and scored by a human-validated, tool-agnostic autorater. GeoKTools consists of templated queries with deterministic reference solvers that systematically vary the number of required tool types. We also use two external benchmarks, CBGB and UnivEARTH; the latter we find to be saturated. To isolate the contribution of GRA's tools and its agentic orchestration, we compare four configurations, each with Gemini 3.1 Pro and 3.8 Flash: a standalone LLM, the LLM with basic tools, the LLM with GRA's skills and tools but without its upfront planning and execution guidance, and GRA itself. With at most basic tools, an advanced model recovers much of the answer on templated queries but satisfies only a small fraction of the expert workflows on open-ended problems; GRA performs well on both. The largest step comes from GRA's skills and tools; on open-ended problems, its planning and execution guidance add a further gain with Gemini 3.8 Flash, letting Flash match or exceed Pro at lower cost.

新论文 · v1arXiv:2610.12970Apple ML Research

Minions:构建在闲置 Apple Silicon 设备上的动态分布式虚拟 GPU 云

Minions: A Dynamic and Distributed Virtual GPU Cloud Built on Idle Apple Silicon Devices

Jianhua Li, Yun Xing, Girisha De Silva, Ryan Flint, Kai Yuan, Sean Suchter

AI 速读 基于摘要

Minions 将多台 macOS 设备上闲置的 Apple Silicon GPU 聚合成分布式虚拟 GPU 云,用于执行大规模机器学习推理任务。

cs.DC · cs.LG

查看原文摘要

The increasing demand for GPU-accelerated machine learning inference has exposed limitations in centralized GPU infrastructures, including high cost, limited elasticity, and long wait times under resource constraints. At the same time, modern Apple Silicon-based macOS devices are equipped with powerful GPUs that remain largely idle during normal usage. This paper presents Minions, a dynamic and distributed virtual GPU cloud that aggregates idle Apple Silicon GPUs across macOS devices to execute large-scale machine learning inference workloads. Minions enables teams to leverage existing hardware without requiring additional GPU procurement. The system provides flexible GPU inference task execution, fault tolerance, and efficient resource utilization. Our experience shows that idle macOS devices can be transformed into a practical distributed GPU inference platform in environments where centralized GPU resources are constrained.

版本更新 · v2arXiv:2610.01892Apple ML Research

基于选择的结构化推理:迈向高效多模态搜索智能体

Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents

Feiyu Gavin Zhu, Xiaoyu Zhu, Jiqi Yang, Rui Yang, Arnab Kumar Mondal, Yancheng Wang, Xinke Deng, Jean Oh 等 12 位作者

AI 速读 基于摘要

将多模态智能体的开放式推理改为从预设自然语言候选集中选择,以提升推理效率并保持任务表现。

cs.LG · cs.AI

查看原文摘要

Multimodal agents commonly generate free-form reasoning before each action. For small models, limited model capacity can result in lengthy reasoning that provides little useful guidance for action generation while incurring substantial inference cost. To address this challenge, we introduce Selection-based Structured Reasoning (SSR), a framework that reformulates reasoning as selection instead of open-ended generation. SSR represents recurring high-level reasoning as pre-specified, reusable natural-language candidates. At each turn, the model selects from these reasoning candidates based on their likelihoods given the current context, without requiring an auxiliary task head. Using pre-specified reasoning traces enables parallel scoring, where teacher-forced prefilling computes token likelihoods concurrently within and across candidates using a shared context KV cache. We evaluate SSR on seven multimodal search benchmarks using 2B and 4B models. Across multiple reinforcement learning objectives and supervised fine-tuning, SSR delivers significant efficiency gains without sacrificing task performance. SSR achieves an average success rate competitive with leading search agents of the same scale, while reducing per-turn reasoning latency by over 90% and total per-question model inference latency by 28-54%. Project page: https://zfy0314.github.io/ssr-webpage/.

版本更新 · v2arXiv:2610.09117Berkeley BAIR

Workhorse: Learning Robust Whole-Body Humanoid Loco-Manipulation from Human Data

Songbo Hu, Qiayuan Liao, Yufeng Chi, Kevin Zakka, Yakun Sophia Shao, Pieter Abbeel, Koushil Sreenath

原文摘要

Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulation from robot-free human demonstrations. A visual planner predicts five-link targets: the poses of the torso, both wrists, and both feet. A reinforcement-learning whole-body tracker follows them on the robot. Both policies train separately on the same recorded human poses, without retargeting. We augment the training data of each policy to imitate the errors that the other makes at deployment. On a real Unitree G1, Workhorse transport boxes with its hands and a kick, catches a thrown box, and topples and climbs a suitcase. During box transport, we show recoveries after a person pushes the robot or takes the box away. In a simulated copy of the demonstration room, the system completes box transport in 77% of episodes, and in 64% under 40 N.s pushes. With both policies retrained from the same demonstrations, a simulated second humanoid completes box transport in 83% of episodes without pushes.

cs.RO · cs.LG

新论文 · v1arXiv:2610.10945Apple ML Research

GHARP:基于大规模重建先验的实时高斯头部动画

GHARP: Real-time Gaussian Head Animation from Large-scale Reconstruction Prior

Ali Benlalah, Sepehr Johari, Patricia Vitoria, Armin Kappeler, Artem Sevastopolsky, Alexander Jung, Gabriele Fanelli, Kevin Mader 等 17 位作者

AI 速读 基于摘要

GHARP 将头部动画解耦为离线身份建模与实时表情残差预测两阶段,并引入身体对齐网络缓解身体与衣物区域的不确定性,作者报告在 Ava-256 上达到先进质量且推理显著加速。

cs.CV · cs.LG

查看原文摘要

We present GHARP (Real-time Gaussian Head Animation from Large-scale Reconstruction Prior), a method that animates 3D human heads in real time from a few input images of a subject and a driving expression signal. We decouple the problem into an identity stage that builds a representation of the subject's geometry and appearance offline, and an animation stage that predicts expression-dependent residuals on top of it at runtime. This separation offers a favorable trade-off with respect to fidelity, quality and runtime: the identity stage can be expensive while the animation stage runs a lightweight network, optimized for mobile devices. Our method performs animation in a semantically structured latent space of a pretrained reconstruction model, where expression changes remain spatially contained, making residual prediction efficient. This reconstruction prior provides a consistent spatial layout, allowing fusion of multiple input views into a compact, fixed-size canonical Gaussian representation. While this two-stage design improves the runtime-quality trade-off, it still inherits a problem common to all expression-driven avatar methods: expression codes describe only the face and thus omit body pose and clothing position, making these regions underspecified in the input. The animation network faces an ill-posed mapping and resorts to averaging over conflicting body appearances, producing blur and temporal flicker. We address this with a body alignment network that learns to align the person's body in the target image with the input reference images, removing the ambiguity from the training signal. Our method achieves state-of-the-art quality on the Ava-256 benchmark while running up to 13x faster on an A100 GPU with 8x fewer Gaussians.

新论文 · v1arXiv:2610.10918Apple ML Research

大语言模型用于机器翻译质量标注:人类与模型均面临挑战

Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged

Hala Almaghout, Christian Federmann, Qin Gao

AI 速读 基于摘要

该研究比较LLM与人类标注者在MQM和ESA两种机器翻译质量评估方案上的一致性,发现两者在不同方案、语言对和领域间差异显著,多数设置下仍不可靠。

cs.CL

查看原文摘要

Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation. With MT evaluation spanning a large number of language pairs, domains and levels of annotation granularity, LLMs must be thoroughly evaluated across these dimensions before being reliably used as alternatives to human evaluation. In this paper, we evaluate the performance of LLMs for two prominent MT quality evaluation schemes: Multidimensional Quality Metrics (MQM) and Error Span Annotation (ESA) by comparing their agreement with human annotators. We present results on a long-context test set of 70 language pairs and the publicly available WMT23 and WMT25 data, investigating both score and error span annotation agreement across a variety of language pairs and domains. Our results show that while LLM agreement with human annotators exceeds agreement between human annotators for some evaluation tasks, both vary substantially across annotation schemes, language pairs and domains and remain unreliable for most settings. Furthermore, we identify challenges facing both human and LLM annotators: humans are particularly challenged by fine-grained MQM annotations and low-resource language pairs, while LLMs struggle with minor errors, wrong language variants and error span annotation. Our results highlight the potential for improvement for both human and LLM annotation performance, possibly through human-LLM collaborative annotation pipelines that address the reliability issues identified in this work.

版本更新 · v3arXiv:2504.12110Google Research

面向地球观测的LLM智能体

Towards LLM Agents for Earth Observation

Chia Hsiang Kao, Wenting Zhao, Cheryl Lam, Aarush Umap, Shreelekha Revankar, Samuel Speas, Snehal Bhagat, Rajeev Datta 等 13 位作者

AI 速读 基于摘要

作者构建了基于NASA地球观测文章与Google Earth Engine的编码基准UnivEARTH,发现零样本LLM智能体在地球观测问答上准确率仅40.0%,使用Reflexion后提升至约60%,但仍仅略高于随机水平。

cs.AI

查看原文摘要

Earth Observation (EO) provides critical planetary data for environmental monitoring, disaster management, climate science, and other scientific domains. In this work we ask: Are AI systems ready for reliable Earth Observation? To answer this, we introduce UnivEARTH, a coding benchmark of 408 yes/no questions from NASA Earth Observatory articles across 7 various topics and over 15 satellite instruments and sources. Using Google Earth Engine API as a tool in a zero-shot setup, LLM agents achieve an accuracy of 40.0% where the code fails to run over 44% of the time. To better understand LLM agent behavior, we also analyze the impact of using the JavaScript API versus Python and the effect of providing documentation. Furthermore, we find that using a Reflexion framework significantly reduces errors: Claude-4.5-Sonnet, Gemini-2.5-Pro, and GPT-5 accuracies rise to around 60%. However, these results remain only marginally above random chance. Taken together, our findings identify significant challenges to be solved before AI agents can automate earth observation, and suggest paths forward.

版本更新 · v3arXiv:2602.03002Berkeley BAIR

RPL: Learning Robust Humanoid Perceptive Locomotion on Challenging Terrains

Yuanhang Zhang, Younggyo Seo, Juyue Chen, Yifu Yuan, Koushil Sreenath, Pieter Abbeel, Carmelo Sferrazza, Karen Liu 等 10 位作者

原文摘要

Humanoid perceptive locomotion has made significant progress and shows great promise, yet achieving robust multi-directional locomotion on complex terrains remains underexplored. To tackle this challenge, we propose RPL, a two-stage training framework that enables multi-directional locomotion on challenging terrains, and remains robust with payloads. RPL first trains terrain-specific expert policies with privileged height map observations to master decoupled locomotion and manipulation skills across different terrains, and then distills them into a transformer policy that leverages multiple depth cameras to cover a wide range of views. During distillation, we introduce two techniques to robustify multi-directional locomotion, depth feature scaling based on velocity commands and random side masking, which are critical for asymmetric depth observations and unseen widths of terrains. For scalable depth distillation, we develop an efficient multi-depth system that ray-casts against both dynamic robot meshes and static terrain meshes in massively parallel environments, achieving a 5-times speedup over the depth rendering pipelines in existing simulators while modeling realistic sensor latency, noise, and dropout. Extensive real-world experiments demonstrate robust multi-directional locomotion with payloads (2kg) across challenging terrains, including 20° slopes, staircases with different step lengths (22 cm, 25 cm, 30 cm), and 25 cm by 25 cm stepping stones separated by 60 cm gaps.

cs.RO

新论文 · v1arXiv:2610.02204Berkeley BAIR

Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents

Yen-Jen Wang, Haozhe Jiang, Shuying Deng, Haoru Xue, Weirui Ye, Rocky Duan, Nika Haghtalab, S. Shankar Sastry 等 10 位作者

原文摘要

Building reliable robot capabilities across diverse tasks requires substantial human effort to develop and maintain skills, design rewards, and integrate perception with control. We present Reconstruct, Practice, Go Real (RPG), a framework for autonomous improvement of robot execution systems without updating model weights. RPG identifies manipulation capabilities in an offline dataset and constructs related practice tasks in simulation. During practice, RPG uses execution feedback, privileged simulator state, and available dataset videos to diagnose failures. It develops new reusable symbolic skills, refines existing skills, and revises the system prompt based on these diagnoses. Cross-task evaluation tests individual candidate changes and merged revisions before they are retained for reuse. At test time, a multimodal LLM uses the resulting system prompt and skill library to coordinate perception and robot control. On held-out initializations of 22 manipulation tasks, RPG improves task success from 28.6% after the first practice round to 95.0% after 15 rounds, outperforming all evaluated baselines, including ASPIRE (75.5%) and CaP-Agent0 powered by GPT-6 Astra Pro (60.0%). After a common calibration and hardware-adaptation procedure, the frozen system succeeds in all 30 physical trials, with ten trials on each of three tasks. Project Website: https://rpg-robot.github.io/

cs.RO · cs.AI · eess.SY

版本更新 · v2arXiv:2609.09158Berkeley BAIR

TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model

Anqi Li, Yuxin Chen, Zhaobo Li, Zhuo Cao, Junli Ren, Masayoshi Tomizuka, Dhruv Shah

原文摘要

We study the problem of navigating cluttered indoor environments with a humanoid robot. Unlike conventional methods that model navigation as a 2D path planning problem, humanoid traversal in cluttered environments requires continuous geometry-aware whole-body adaptation, including coordinated arm placement, torso adjustment, and gait modulation for collision-free movement through complex 3D spaces. We introduce TANGO, the first whole-body vision-language navigation framework for language-conditioned humanoid traversal in cluttered environments. Given a natural-language instruction and egocentric RGB observations, TANGO directly predicts 29-DoF joint-space actions for downstream whole-body control. We train TANGO entirely in simulation by synthesizing diverse collision-free traversal behaviors via global path planning, kinematic whole-body motion generation, obstacle-aware motion editing, and RL-based tracking. This pipeline provides dynamically feasible action supervision for learning language-conditioned whole-body policies. In extensive simulation experiments, TANGO demonstrates state-of-the-art performance in vision-language navigation, while outperforming strong modular baselines in navigating challenging scenes requiring obstacle negotiation. Lastly, we deploy TANGO zero-shot on a Unitree G1 humanoid robot, and observe robust language-guided traversal in cluttered real-world scenes without training on any real-world navigation data.

cs.RO · cs.AI

新论文 · v1arXiv:2610.30161HF 社区推荐

TauIndianBankBench: Procedure-Aware, Action-Oriented Evaluation of Tool-Using Conversational Agents

Krishanu Adhikary, Prashant Devadiga

原文摘要

Many Indian banks serve customers through FAQ pages and scripted chatbots. Assistants based on language models could respond faster and carry out requests such as blocking a card, but only if they give correct information and follow the bank's rules. These rules prescribe a procedure, a set of required steps, such as obtaining a closure quote before closing a deposit. Adapting models to this domain requires measuring how well they follow the procedure, before and after training. Benchmarks usually judge only the records left at the end of a conversation. Many required steps, however, leave the records unchanged, so an assistant that skips them can still be judged successful. We present TauIndianBankBench, an action-oriented benchmark of 1,000 Indian retail-banking tasks where an assistant helps a simulated customer. Besides the final records, it checks that the assistant took every required step and made no unrequested change. For every model, 6.5-12.0% of sessions are judged successful when only the final records are checked, although the assistant skipped a required step or made an unrequested change. Scoring both procedure and outcome shows more accurately how well language models perform in Indian retail banking.

cs.CL · cs.AI

版本更新 · v4arXiv:2609.31494Google Research

面向可证明隐私的联邦数据学习

Toward provably private learning from federated data

Katharine Daly, Yu Xiao, Zachary Garrett, Brett McLarnon, Jianpeng Hou, Arun Ganesh, Yanxiang Zhang, Noriyuki Takahashi 等 12 位作者

AI 速读 基于摘要

提出基于可信执行环境(TEE)的下一代联邦学习系统,首次提供可外部验证的中心化差分隐私(DP)保证,并改善隐私-效用权衡。

cs.CR

查看原文摘要

Federated Learning (FL) allows devices with private data to collaborate in training a shared model. We present a next-generation FL system based on Trusted Execution Environments (TEEs) that addresses operational challenges associated with earlier systems and provides externally verifiable central Differential Privacy (DP) guarantees for the first time while offering a better privacy-utility tradeoff. In our system, devices upload data encrypted with keys managed by a TEE-hosted Key Management Service (KMS). The uploaded data is cryptographically tied to a policy limiting the set of Python programs that may later process the data in server-side TEEs. External parties may inspect public transparency logs to observe the set of workloads allowed by these policies. Our experimental results show that the new system improves device coverage and favorably shifts privacy-utility curves by enabling collected data to be integrated into the server-side workload at a schedule that optimizes DP guarantees and is unaffected by device availability. Our new system has been productionized, enabling models for the Android Keyboard (Gboard) to be trained faster and achieve better accuracy under smaller, now externally verifiable privacy budgets in comparison to models trained using the prior system.

新论文 · v1arXiv:2609.38172Berkeley BAIR

Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation

Zihan Wang, Zhen Wu, Pieter Abbeel, Rocky Duan, Jitendra Malik, Carmelo Sferrazza, C. Karen Liu, Guanya Shi 等 9 位作者

原文摘要

Teaching humanoids loco-manipulation skills, such as carrying diverse objects, via visual imitation is a promising path toward generalist robots. However, collecting diverse, high-quality interaction videos, such as clips that clearly show a person's full body and unoccluded interactions with objects, poses a practical barrier to scaling this approach. We propose PRISM, a real-to-sim-to-real framework that overcomes this limitation by amplifying a handful of real videos into a large, diverse training set. PRISM first generates hundreds of diverse "counterfactual" human-object interaction videos via video-to-video (V2V) generation from a few exemplar real videos. Our contact-anchored real-to-sim pipeline then reconstructs both human and object motions, retargeting this imperfect video data into physically plausible trajectories. The intra-class variability across these counterfactual videos lets us train a single policy that generalizes to unseen objects within each category. We demonstrate the full pipeline by deploying this policy on a real robot without any real-world fine-tuning. Using only onboard depth observations, our humanoid picks up, carries, and drops objects, including boxes, barrels, bins, and balls, across novel instances, sizes, and initial configurations.

cs.RO · cs.CV · cs.GR

版本更新 · v2arXiv:2602.11328Google Research

Evaluating Alignment of Behavioral Dispositions in LLMs

Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein 等 11 位作者

原文摘要

As people turn to LLMs for social advice, understanding their behavior in such contexts becomes essential. In this work, we focus on behavioral dispositions: the underlying tendencies that shape responses in social contexts. We introduce STAR, a framework for studying how closely the dispositions expressed by LLMs align with those of humans. STAR builds on established psychological questionnaires, adapting their items into realistic advice-seeking scenarios, as self-report may not transfer to actual advisory behavior. Using STAR, we construct a dataset of 23k scenarios, each validated by 3 raters and annotated with preferences from 10 participants. Across 25 LLMs, we find that (1) when human consensus is high, frontier models can fail to reflect it in 15-20% of cases, and smaller models fail at substantially higher rates; (2) when humans disagree, LLM recommendations are substantially less diverse than human choices, both within individual models and even across models from different providers, potentially narrowing the range of options users are guided toward; (3) LLMs' self-reported values are poor predictors of their recommendations. To support future research we make our dataset and code publicly available.

cs.CL

首次观测 · 记录 #1软件学报:jos:7716软件学报

面向航天控制系统的系统级需求描述语言

陈小红, 綦艳霞, 阮锟, 林靖凯, 金芝, 钟睿明, 顾斌, 杨孟飞

原文摘要

航天控制系统(aerospace control system, ACS)构成复杂、软硬件交互紧密, 其需求多采用自然语言描述, 固有歧义性及硬件细节引用易出错, 导致需求传递易生偏差, 软件资产跨型号复用困难等问题. 为解决这些问题, 设计面向航天控制系统的系统级需求描述语言SpaceRDL. 其核心贡献在于引入“系统资源”作为其交互环境实体与物理设备的统一抽象, 使工程师能够以结构化方式精确定义对系统资源的操作, 从而在需求描述语言层消除歧义性, 避免引入过多细节. 该语言通过引入系统资源库, 设计具有良定语义的原子操作指令, 实现任务意图向软件实现的自动化映射, 采用SpaceRDL描述的任务需求也成为跨项目迁移的可复用资产. 案例研究表明, 该语言能有效刻画航天控制系统需求, 为构建新一代航天软件工程方法提供切实可行的支撑.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

版本更新 · v3arXiv:2608.26088Google Research

行星预测引擎:通过智能数据选择与基础模型嵌入实现自主地理空间预测

Planetary Prediction Engine: Autonomous Geospatial Prediction via Intelligent Data Selection and Foundation Model Embeddings

Evelyn Ma, Rama Kumar Pasumarthi, Kishwar Shafin, Mandar Sharma, Mimi Sun, Hamed Sadeghi, Dav M. Ebengo, Mbulayi Onesime 等 29 位作者

AI 速读 基于摘要

提出自主AI系统PPE,从自然语言查询出发自动完成多模态地理空间数据检索、融合与模型搜索,并在多个健康、风险与流行病预测任务上报告优于专家基线。

cs.AI · cs.LG

查看原文摘要

Addressing critical global challenges, from food security and disaster risk to disease outbreaks and socio-economic vulnerability, demands high-fidelity geospatial modeling. However, building predictive planetary models remains bottlenecked by a fragmented data ecosystem, requiring manual data retrieval, multimodal data curation and fusion along with iterative model selection. We present the Planetary Prediction Engine (PPE), an autonomous AI system that executes this end-to-end workflow directly from natural-language queries. PPE synthesizes multimodal datasets on the fly, retrieving spatiotemporally relevant covariates across open-web and Earth observation platforms (Data Commons, Google Earth Engine) and fusing them with geospatial foundation model embeddings (PDFM, AlphaEarth). Simultaneously, it searches over task-tailored model architecture families with automated overfitting guards. Across diverse tasks, geographies, and scientific domains, PPE consistently outperforms state-of-the-art or manually tuned expert baselines. For US spatial regression, PPE improves mean $R^2$ across 21 CDC health indicators (76.8% vs. 60.0%), FEMA national risk indices (64.9% vs. 60.0%), and the Social Vulnerability Index (66.2% vs. 58.6%). For spatial downscaling in data-scarce settings, PPE integrates localized proxies to double baseline accuracy in Nigerian food security indicators ($R^2$ of 66.1% vs. 31.5%). For epidemiological nowcasting of the 2026 DRC Bundibugyo Ebola outbreak, PPE achieves a Recall@10 of 83.3% (identifying 15 of 18 newly invaded health zones across five weekly forecasts), a +10.3 percentage-point improvement over the public state-of-the-art modeling (~73%). By combining autonomous multimodal planetary data discovery with targeted model optimization, PPE lowers the technical barrier to planetary-scale analytics, enabling rapid, customized, expert-level deployment.

首次观测 · 记录 #1软件学报:jos:7667软件学报

RinKGC: 角色交互关系感知的知识图谱补全方法

刘海, 李菲菲, 刘婷婷, 杨雪雪, 王敏红, 张昭理

原文摘要

知识图谱补全是更新知识图谱的重要手段. 然而, 知识图谱通常包含许多复杂关系类型, 导致同一实体在不同的三元组中扮演着不同的角色. 此外, 实体本身蕴含着多样化的属性与语义特征, 不同三元组对实体语义的关注维度不尽相同. 针对上述挑战, 提出一种基于角色交互关系感知的知识图谱补全方法RinKGC, 该方法包含3个模块, 分别是角色线索生成模块、角色交互关系挖掘模块和角色语义增强模块. 具体地, 角色线索生成模块能够准确定位三元组中头实体、关系和尾实体的角色, 增强实体和关系之间的交互, 同时通过残差连接在不同层之间传递语义信息. 角色交互关系挖掘模块将实体和关系的特征维度划分为多个子空间, 并在各子空间中分别建模实体和关系的交互, 实现对不同语义特征的高效感知. 角色语义增强模块则是通过利用互补信息来实现目标实体的准确预测. 此外, 引入Transformer作为主干网络, 揭示不同三元组之间的长距离语义依赖关系. 通过在多个公开知识图谱补全数据集上的大量实验, 展现RinKGC方法获得的优异性能.

cs.*

软件学报 · 2026 · 正式发表

首次观测 · 记录 #1软件学报:jos:7717软件学报

大规模电力数据库自动构建与查询生成技术

刘源, 张远来, 张仕浩, 李昕原, 赵奕轲, 高明, 兰韵诗, 岳昆

原文摘要

电力行业的数字化进程催生了海量的结构化业务数据, 关键业务对自然语言驱动的高效数据查询需求日益迫切. 然而, 电力数据库普遍存在模式庞大、字段语义模糊和查询复杂等特点, 当前查询方式仍高度依赖人工编写SQL, 效率低且可能导致运维或调度决策错误. 尽管大语言模型(large language model, LLM)与Text-to-SQL技术为该问题提供了新的解决思路, 却因电力领域数据库的自身特点而导致适配性有限. 针对上述挑战, 提出模型无关的Text-to-SQL框架ElectricSQL, 该框架通过LLM模仿学习和SQL视图模式转化, 在不依赖特定商业大模型的前提下提升复杂电力业务查询的SQL生成性能. 同时, 构建一个面向真实电力业务场景的Text-to-SQL基准数据集PowerSQL. 实验结果表明, ElectricSQL在PowerSQL数据集上显著优于主流基线, 且在多类开源LLM上实现了稳定性能增益, 验证了所提方法的有效性并为电力领域自然语言查询系统构建和垂类领域Text-to-SQL研究提供了可复用方案.

cs.* · cs.CL

软件学报 · 2026 · 正式发表

首次观测 · 记录 #1软件学报:jos:7720软件学报

预测不确定性感知的测试集选择方法

高玉鑫, 黎浩坤, 张书海, 陈卓琨, 马钟, 魏璐, 许守恺, 游增 等 11 位作者

原文摘要

随着深度学习模型在嵌入式与边缘设备中的广泛应用, 传统依赖完整测试集的模型评估方法因其高昂的计算开销与资源消耗, 难以满足低延迟且高效率的部署需求. 现有数据集选择方法往往难以兼顾评估精度与高压缩比, 导致性能估计偏差显著. 为此, 提出一种预测不确定性感知的测试集选择(prediction-uncertainty-aware test set selection, PUA-TSS)方法, 旨在通过构建高信息量的代理测试集, 实现对模型性能的高效准确评估. 该方法首先利用模型预测输出的信息熵量化样本不确定性, 对测试样本进行任务驱动排序; 在此基础上, 采用等间隔均匀采样策略, 保留关键分布特征, 尤其缓解长尾场景下稀有类别的丢失问题, 从而在低采样率下维持评估的敏感性与一致性. 在图像分类和目标检测以及分割等多个任务上的基准数据集及多种模型架构上的实验表明, 所提方法在仅保留5%测试样本的情况下, 代理集评估结果与完整测试集评估的平均绝对偏差分别控制在0.71个百分点 (分类)、2.90个百分点 (检测)以及0.40个百分点 (分割)以内, 显著优于随机采样与现有数据集压缩方法. 进一步地, 在评估不同位宽的量化模型时, 性能评估误差稳定控制在5个百分点以内, 且无需为各模型变体重复构建代理集或执行完整评估. 实验结果验证了PUA-TSS方法在大幅降低模型评估计算成本的同时, 具备高精度与强鲁棒性以及良好泛化能力, 为资源受限环境下的模型评估提供了一种有效解决方案.

cs.* · cs.CV

软件学报 · 2026 · 正式发表

首次观测 · 记录 #1软件学报:jos:7723软件学报

结合置信度分区和模糊测试的二进制幽灵漏洞检测方法

万俊棋, 马自强, 高菲, 张增旺, 蒲通骏, 冯小旭

原文摘要

Spectre V1漏洞利用处理器推测执行机制窃取敏感数据, 对闭源二进制程序的检测尤为困难——静态分析易产生高误报, 动态模糊测试则存在覆盖受限、报点噪声大的问题. 为解决这一问题, 提出一种名为ConSpec的二进制Spectre V1检测方法. 该方法先通过轻量BERT模型对反汇编指令序列进行语义建模, 结合Spectre V1的汇编语义模式, 生成函数级置信度以量化漏洞可疑度; 再依据置信度将函数划分为高、中、低风险区, 通过白名单驱动的定向插桩与分级配置, 并采用覆盖率引导的模糊测试驱动插桩后的程序反复执行以采集漏洞证据, 让检测资源集中投向高风险区域, 同时控制整体开销. 针对动态验证报点存在噪声且覆盖受限导致遗漏的问题, 引入窗口级二次确认机制, 通过匹配特定语义模板与局部寄存器追踪, 验证漏洞相关的关键证据链, 实现误报筛选与漏报补充. 实验结果表明, ConSpec能完整覆盖15种已知Spectre V1利用模式. 在jsmn、brotli、OpenSSL等5个真实程序上的测试显示, 与Teapot相比, ConSpec的精确率平均提升约24.3个百分点, F2分数平均提升约24.4个百分点, 相对漏报率整体下降; 平均耗时由1159.7 min降至774.3 min, 降幅为33.2%.

cs.*

软件学报 · 2026 · 正式发表