标题为英语Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities
A deployed LLM agent emits tool calls, queries, and code that can be silently wrong -- by the time the error surfaces, the action has run. Frontier chat APIs hide the model's token probabilities; the agent's stated confidence barely beats chance on the mistakes that matter; and…
AI 摘要：要点
- A deployed LLM agent emits tool calls, queries, and code that can be silently wrong -- by the time the error surfaces, the action has run
- Frontier chat APIs hide the model's token probabilities; the agent's stated confidence barely beats chance on the mistakes that matter; and…
Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities
相关文章
ENA Controlled LLM Workflow for Evidence-Grounded Diagnosis of Risk Score Differences
arXiv:2610.23962v1 Announce Type: new Abstract: We propose a controlled Large Language Model (LLM) workflow for explaining risk score differences using similar historical transactions. The workflow combines reference retrieval and contrastive SHapley Additive exPlanations (SHAP)…
ENBeyond Explicit Intent: Discovering and Shaping Artistic Intent through Human-AI Co-Creation
arXiv:2610.24010v1 Announce Type: new Abstract: Generative AI is becoming an important medium for artistic creation, yet existing interactions often assume that creators can specify intentions in advance and accurately communicate them through text prompts. Artistic intentions,…
GardenBench：LLM能力的轻量级每日评估
arXiv:2610.23866v1 通告类型：新 摘要：我们推出GardenBench，这是一个包含11个测试套件的基准，用于评估大语言模型（LLM）在一系列任务中的能力。通过系统地用各种轻量级查询提示LLM，我们记录了…
ENLogicVal:A Logic-Formalized Benchmark for Constraint Satisfaction in Text-to-Image Generation
arXiv:2610.24051v1 Announce Type: new Abstract: Text-to-Image (T2I) generative models have made significant progress in producing high-fidelity images from natural-language prompts. Alongside this progress, numerous benchmarks have been developed to evaluate capabilities such as…