Компании

Introducing SWE-bench Verified

We’re releasing a human-validated subset of SWE-bench that more reliably evaluates AI models’ ability to solve real-world software issues.

13 August 2024 · Source: OpenAI news

The full text is available at the source.

Read at the source →

More in this topic

КомпанииPartnering with Hacktron to find vulnerabilities in OpenAI’s systemsOpenAI is partnering with Hacktron to find vulnerabilities, test connections with third-party services, and strengthen defenses with frontier AI.OpenAI news3 days ago

КомпанииMeasuring how AI agents handle everyday wet-lab scienceOpenAI introduces BioBasicsBench, a 100-task benchmark measuring how well AI agents interpret raw experimental data and handle everyday wet-lab science.OpenAI news4 days ago

КомпанииCult.fit builds operational muscle with CodexCult.fit is using Codex to help teams across functions build tools, move faster, and change how work gets done.OpenAI news4 days ago

КомпанииAustralian universities are creating AI-native graduatesAustralian universities are expanding access to ChatGPT and bringing AI into teaching and learning to prepare students for an AI-enabled workforce.OpenAI news4 days ago