Компании

Why we no longer evaluate SWE-bench Verified

SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

23 February 2026 · Source: OpenAI news

The full text is available at the source.

Read at the source →

More in this topic

КомпанииPartnering with Hacktron to find vulnerabilities in OpenAI’s systemsOpenAI is partnering with Hacktron to find vulnerabilities, test connections with third-party services, and strengthen defenses with frontier AI.OpenAI news3 days ago

КомпанииMeasuring how AI agents handle everyday wet-lab scienceOpenAI introduces BioBasicsBench, a 100-task benchmark measuring how well AI agents interpret raw experimental data and handle everyday wet-lab science.OpenAI news4 days ago

КомпанииCult.fit builds operational muscle with CodexCult.fit is using Codex to help teams across functions build tools, move faster, and change how work gets done.OpenAI news4 days ago

КомпанииAustralian universities are creating AI-native graduatesAustralian universities are expanding access to ChatGPT and bringing AI into teaching and learning to prepare students for an AI-enabled workforce.OpenAI news4 days ago