Evaluating Model Capabilities After Benchmark Saturation
arXiv:2610.20667v1 Announce Type: new Abstract: Rapid advances in AI capabilities are causing benchmarks to saturate. Once several models approach perfect scores, a benchmark loses its power to differentiate between them, and with it its utility for informing AI safety cases and…
- 01.arXiv:2610.20667v1 Announce Type: new Abstract: Rapid advances in AI capabilities are causing benchmarks to saturate
- 02.Once several models approach perfect scores, a benchmark loses its power to differentiate between them, and with it its utility for informing AI safety cases and…
This material is provided as an extended analytical summary.
Read full article at sourceRelated Intelligence
All stories →GPT-6.1 Terra halves OpenAI's API prices and still gains ground on its larger models
OpenAI has released GPT-6.1 Terra, a mid-range model that cuts API prices in half compared to its predecessor. Analysts say it sets a new standard for intelligence per dollar, especially for everyday computing tasks and AI-driven computer control. The article GPT-6.1 Terra…
How Sullivan & Cromwell builds legal tools with Codex | OpenAI
At Sullivan & Cromwell LLP, John Savva uses Codex to build tools around the firm’s legal expertise. Agreement Analyzer brings together a draft agreement, selected precedents, and playbooks reflecting the firm’s and client’s positions. It identifies potential issues and returns a…
Hebbia on Astra: Better research, better presentations | OpenAI
“We see Astra actually show over double digit gains over any other model we've tested on two fronts.” Hebbia’s Kavita Anand names the two: selecting the right sources and generating PowerPoint presentations. For a banker or investor working through a data room with thousands of…