When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents
Large language model agents rely on external harnesses to pass information between the model and its environment and to recover from execution errors. Yet recovery is usually judged only by average task success. This hides an important tension. The same operation can rescue a…
- 01.Large language model agents rely on external harnesses to pass information between the model and its environment and to recover from execution errors
- 02.Yet recovery is usually judged only by average task success
- 03.This hides an important tension
This material is provided as an extended analytical summary.
Read full article at sourceRelated Intelligence
All stories →OpenAI announces three big science discoveries and a new way to work with academics
Less than a month after its mass release of hundreds of manuscripts that it said contained solutions to long-standing mathematics questions, OpenAI is back with three more "major" discoveries in math, computer science, and physics. What's different this time is the choice to…
Anthropic files for IPO
The placement volume and price per share have not yet been announced
Anthropic uses gas to fuel AI growth
Anthropic reports on its centers' dependence on natural gas and the associated risks.