从装饰到承重:任务难度塑造思维链的因果作用
仅当书面推理因果性地限制答案时,思想链 (CoT) 监控才有意义。我们引入基于连续的因果测试,这是一种消融补丁干预,它会扰乱一个推理步骤,截断链条,并迫使模型从……继续下去。
All published intelligence, sovereign stack research, ecosystem news, and AI foundation model reviews.
仅当书面推理因果性地限制答案时,思想链 (CoT) 监控才有意义。我们引入基于连续的因果测试,这是一种消融补丁干预,它会扰乱一个推理步骤,截断链条,并迫使模型从……继续下去。
现代信息检索越来越多地采用嵌入模型和生成模型来处理复杂的查询。然而,当前的服务系统由于单独执行这些模型而面临吞吐量低和 GPU 利用率低的问题。粗粒度划分,...
基于失败的文本知识蒸馏旨在通过检查模型的任务错误来发现模型知识中的差距。提炼的知识可用于该模型(“源模型”)和其他模型的推理。然而,这种知识转移可能并不……
企业环境中的结构化数据代理必须对复杂的数据环境进行推理,其相关证据分布在模式、关系、策略和重复业务角色中。现代代理系统通常通过可重用的降价风格来解决这个负担……
在语言模型中寻找回路通常意味着进行许多仔细的干预。我们尝试一些更简单的方法:将注意力视为来自一次前向传递的路由图,保留一小组指向答案的路由,并询问这些路由是否真的重要。他们…
在重复的工作中,代理人的表现不一致。我们运行 42 个任务,每个任务 3 次,发现根据模型的不同,38% 到 74% 的人返回的答案不一致。一致性是买家、审计员或监管机构所要求的,而代理商却没有。他们也很浪费:...
大型语言模型越来越多地被部署为特定课程的导师,但它们的实用性取决于经过审查的教学材料的基础,而这些材料通常会在学期中期进行修订。我们之前的工作在……上构建了一个多模态检索增强生成(RAG)系统。
我们经常通过展示工作并解释我们所做的决定来教导同事。我们如何检查代理从同一课中理解了什么?我们介绍 ShowTellArena,这是一个基准协议和公共数据集,用于在叙述的业务演示后进行理解。这…
手势识别是人机交互 (HCI) 的关键组成部分,可为游戏、虚拟现实 (VR)、机器人等应用程序提供直观的界面。这项研究集成了基于变压器的机器学习模型,用于实时手势……
初级保健中的前瞻性卒中风险分层具有挑战性,因为早期风险信号分布在常规生物标志物和非结构化临床叙述中。我们提出 MedGate-Fusion,一种多模式门控架构,集成了基于变压器的……
Organizations deploying agentic artificial intelligence must determine more than whether a model is trustworthy; they must establish what to validate, control, and observe for a use case to deliver its intended outcome while meeting applicable obligations. This paper proposes…
Understanding and modeling human intelligence are parallel goals shared by artificial intelligence (AI) and cognitive science. As AI systems grow increasingly capable, in what ways do model responses resemble human responses, and where do they systematically diverge? The sheer…
Automated macro placement remains a fundamental challenge in VLSI physical design. Despite decades of research, existing approaches predominantly optimize hand-crafted proxy objectives, such as estimated wirelength, and typically produce placements through one-shot numerical…
Production LLM agents are evaluated repeatedly as they evolve, but full agent benchmarks are costly to rerun. We study efficient recurring evaluation for a production analytics agent serving tens of thousands of monthly active users and report first-hand deployment experience.…
Autonomous software generation (ASG) aims to turn human requirements into executable applications, but delivering these applications does not necessarily establish that their interacting components satisfy the specified behavioral requirements. We introduce GameASG-Bench, a…
Agentic marketplaces are emerging where AI agents with varying capabilities autonomously complete specialized tasks for buyers. A major challenge of such marketplaces is that buyers cannot easily determine which agent will perform best on their tasks. Reported benchmark scores…
Air operations rely on complex rules, established procedures, and time-critical analysis under limited connectivity and strict security constraints. In such environments, analysts must combine written doctrine with images, often without access to external computing resources.…
Multimodal trajectory prediction improves behavioral coverage in end-to-end autonomous driving, but existing methods remain limited by sparse scene representations. Incomplete evidence leads to low-quality candidate generation and unreliable ranking among geometrically similar…
Sparse representation formulates the environment perception for the end-to-end driving system as a set of discrete elements like objects and lane lines. This formulation meets safety risks in crowded, occluded scenes dealing with unstructured obstacles, uncertain regions, and…
Post-training plays a pivotal role in enhancing the reasoning capabilities and task-specific expertise of large language models (LLMs). Despite recent advances in post-training methods, such as Group Relative Policy Optimization (GRPO), their practical deployment remains impeded…
Online agent deployments produce abundant execution traces, while task-specific verification and expert annotation are costly to scale. We study how to distill these traces into reusable feedback without post-hoc outcome labels, drawing on their evidence of local progress,…
Long-context large language model inference is increasingly limited by prefill, where dense self-attention processes the entire prompt before generation begins. Sparse block selection can reduce this cost, but a block centroid may hide a highly relevant token among many…
In Mixture-of-Experts language models, the router typically selects and weights experts based on the token's hidden state, utilizing limited contextual information. We propose Attention-Aware Routing (AAR), which augments the router with temporal and spectral features extracted…
Autoregressive (AR) models suffer from local greediness, while diffusion language models (DLMs) often lack the strict causal structure required for reasoning. To combine the advantages and overcome the drawbacks of the dual, we propose Causal Latent Revision (CaLR), a framework…
Automatic target recognition (ATR) with synthetic aperture sonar (SAS) supports advanced naval capabilities, but deep learning is constrained by scarce target imagery, background clutter, and human-in-the-loop assessment. We adapt DINOv3 Vision Transformer (ViT) models to…
In this work, we examine the topology of information flow patterns within attention graphs to effectively distinguish hallucinated from non-hallucinated responses. We analyze the Forman-Ricci curvature to identify structural patterns indicating information bottlenecks in…
Fine-tuning has emerged as a widely adopted approach for adapting LLMs to a variety of downstream tasks. However, how it reshapes their internal mechanisms remains poorly understood. To address this, we investigate how fine-tuning alters internal representations in LLMs,…
Replacing attention in a pretrained language model is a compatibility problem: a plausible substitute may alter representations expected by later layers. TinyCeNN-LM introduces a \emph{quality-gated post-training conversion} framework using CeNN-inspired cellular-recurrent…
Before patients can use AI-assisted psychiatric intake systems, health systems need practical ways to routinely evaluate these tools against their clinical standards for quality assurance. Because clinicians may use different intake styles, evaluation for this task must (1)…
Large Language Model (LLM) agents are increasingly being explored for chip design, but most existing approaches operate directly at RTL. We ask whether agents can design better chips by leveraging higher-level abstractions. We compare Direct RTL Design, Agent-based HLS Design,…