arXiv:2611.08666v1 Announce Type: new Abstract: Interactive debuggers are indispensable to human software development, yet coding agents overwhelmingly rely on edit-execute-observe loops, using common bash tools, test scripts, and print statements to debug via repeated shell commands. Stepping through a debugger provides live access to runtime state, which may enable different problem-solving capabilities. However, prior work typically introduces the debugger as an additional tool or through a new subagent, making its individual contribution difficult to isolate from the associated scaffold changes. To address this, we compare a debugger-only agent against a bash-only agent on all 500 SWE-bench Verified instances, holding the rest of the scaffold fixed. We evaluate both architectures on two models, GPT-OSS-120B and Nemotron-3-Ultra-550B, with three independent runs per architecture $\times$ model configuration. Crucially, to distinguish interface specialization from expanded coverage under repeated sampling, we introduce pass$_X$@$k$, a cross-agent pass@$k$ that provides an unbiased estimator of the probability that at least one of $k$ agents is successful. Although the bash and debugger agents solve partially disjoint subsets of the benchmark in any single pair of runs, our pass$_X$@$2$ estimator reveals that this is largely due to run-to-run variance rather than tool complementarity. Across both models, we find that two bash rollouts outperform the combination of one bash and one debugger rollout. Our findings highlight the importance of accounting for stochastic variance in evaluating agent and tool diversity, and we hope that pass$_X$@$k$ will serve as a useful framework for the community.
Research2 分钟阅读
Pdb 或非 Pdb: 使用 Pass$_{X}$@$k$ 比较调试界面
arXiv:2611.08666v1 通告类型: new 摘要: 交互式调试器对人类软件开发不可或缺,但编码代理绝大多数依赖编辑-执行-观察循环,使用常见的 bash 工具、测试脚本和打印语句通过重复 shell 进行调试…
arXiv — cs.AI作者: Ryan Magnuson, Ellie Kitanidis, Ariel Lee2026年11月9日 (2小时前)
提供 4 种语言版本AI 摘要:要点
- arXiv:2611.08666v1 通告类型: new 摘要: 交互式调试器对人类软件开发不可或缺,但编码代理绝大多数依赖编辑-执行-观察循环,使用常见的 bash 工具、测试脚本和打印语句通过重复 shell 进行调试…
Research
KZ·AI A887Инсайт дня
Pdb 或非 Pdb: 使用 Pass$_{X}$@$k$ 比较调试界面
全文为英语
内容来自原始来源: arXiv — cs.AI
查看原文查看原文
标签:#arXiv
相关文章
Ripple-65B Preview:面向智能体编程的模型
🌟 Ripple-65B Preview:面向智能体编程的模型。Recursive Intelligence 发布了一个拥有 650 亿参数的智能体编程模型的开放预览版,专注于响应速度。该公司由前 Google 研究员 Anna Goldie 和 Azalia Mirhoseini 创立……
Telegram — AI Machine Learning Big Data
SMNTCN (Semanticon) — глобальные новости ИИ
本周AI热门新闻榜
📌 本周AI热门新闻榜 🔊 ElevenLabs Sound Effects v3 — 根据描述生成声音:从脚步声、爆炸声到环境背景音。 🎨 OpenAI Images 2.6 — 创建GIF动画,图像生成更快,编辑现有图像更精准。 🎬 Gemini Omni 1.2 Flash —…
Telegram — GPT Time | Нейросети | ИИ
面向数据稀缺条件下的LLM自我博弈:有效性、泛化能力与可信度
arXiv:2611.08908v1 公告类型:新 摘要:大语言模型(LLM)的快速发展主要得益于模型规模扩大和人工策划的训练数据,但这一范式正日益受到数据稀缺和人工收益递减的制约…
arXiv — cs.AI