ViBench 2.0: A Benchmark for Long-Horizon Software Building
arXiv:2611.05620v1 Announce Type: new Abstract: On Replit, our agentic engineering platform, users now build entire products without writing code, through successive feature requests to an agent. Yet existing coding benchmarks evaluate single, fully specified tasks, and many are…
AI Summary & Key Takeaways
- arXiv:2611.05620v1 Announce Type: new Abstract: On Replit, our agentic engineering platform, users now build entire products without writing code, through successive feature requests to an agent
- Yet existing coding benchmarks evaluate single, fully specified tasks, and many are…
ViBench 2.0: A Benchmark for Long-Horizon Software Building
Related stories
Claude even bans paid accounts. How not to lose everything?
Claude even bans paid accounts. How not to lose everything? ⠀ Imagine: you pay $200 for Claude Max, manage projects, store correspondence, and one day you see Account Suspended. Access was lost, but the work remained inside. ⠀ In October, complaints about blocking became more frequent, including after...
ChatGPT can now create GIF animations and remember your pets
🎞 ChatGPT can now create GIF animations and remember your pets OpenAI has released Images 2.6, an updated model for generating images. Now in ChatGPT you can create not only pictures, but also animated GIFs. What else is new? • Image generation has become…
Who May Overrule the Agent? Evidence-Gated Authority in LLM Review Institutions
arXiv:2611.05390v1 Announce Type: new Abstract: Multi-agent language-model systems often add a reviewer to improve an upstream agent's decision. Yet a reviewer can both repair errors and replace decisions that were already correct. We study this as a problem of institutional…
Agent Harness Awareness: Turning Verified Telemetry into Operational Control for Tool-Using Agents
arXiv:2611.05391v1 Announce Type: new Abstract: Tool descriptions tell an agent what an action can do, but they do not necessarily reveal whether that action is healthy or suitable at the moment of use. Execution harnesses often possess this information through monitors, traces,…