GardenBench: A lightweight, daily evaluation of LLM capabilities
arXiv:2610.23866v1 Announce Type: new Abstract: We introduce GardenBench, a benchmark with 11 test suites that evaluate the capabilities of Large Language Models (LLMs) across a range of tasks. By systematically prompting LLMs with various lightweight queries, we document…
- 01.arXiv:2610.23866v1 Announce Type: new Abstract: We introduce GardenBench, a benchmark with 11 test suites that evaluate the capabilities of Large Language Models (LLMs) across a range of tasks
- 02.By systematically prompting LLMs with various lightweight queries, we document…
This material is provided as an extended analytical summary.
Read full article at sourceRelated Intelligence
All stories →GPT-6.1 Terra halves OpenAI's API prices and still gains ground on its larger models
OpenAI has released GPT-6.1 Terra, a mid-range model that cuts API prices in half compared to its predecessor. Analysts say it sets a new standard for intelligence per dollar, especially for everyday computing tasks and AI-driven computer control. The article GPT-6.1 Terra…
How Sullivan & Cromwell builds legal tools with Codex | OpenAI
At Sullivan & Cromwell LLP, John Savva uses Codex to build tools around the firm’s legal expertise. Agreement Analyzer brings together a draft agreement, selected precedents, and playbooks reflecting the firm’s and client’s positions. It identifies potential issues and returns a…
Hebbia on Astra: Better research, better presentations | OpenAI
“We see Astra actually show over double digit gains over any other model we've tested on two fronts.” Hebbia’s Kavita Anand names the two: selecting the right sources and generating PowerPoint presentations. For a banker or investor working through a data room with thousands of…