Заголовок на английскомEfficient Benchmarking in Production: A Study of an Evolving LLM Agent

Production LLM agents are evaluated repeatedly as they evolve, but full agent benchmarks are costly to rerun. We study efficient recurring evaluation for a production analytics agent serving tens of thousands of monthly active users and report first-hand deployment experience.…

Похожие материалы

Исследования#OpenAI#Сэм Альтман1 мин

Судья отклонил иск сестры Сэма Альтмана о сексуальном насилии

Во вторник окружной судья США Закари Блюстоун отклонил иск, поданный Энн Альтман в прошлом году, утверждая, что ее брат, генеральный директор OpenAI Сэм Альтман, подвергал ее сексуальному насилию на протяжении всего ее детства. Как ранее сообщало The Guardian, судья написала, что за последний год Энн...

The Verge — AI20 окт.

Исследования#Google DeepMind#Anthropic1 мин

ENAnthropic pitches AI safety bill that may block a model if 50+ people could be killed

The proposed policy seems to offer protections against AI run amok but actually forbids federal agencies from blocking a model's release without the permission of a judge.

TechCrunch — AI20 окт.

Стартапы#OpenAI#Hugging Face1 мин

ENHugging Face CEO warns that Netflix’s OpenAI hack documentary isn’t accurate

Before you share the Netflix documentary "AI Gone Rogue" take note. Clem Delangue, Hugging Face's co-founder who is featured in the film, says it went "full doomer mode" and isn't accurate.

TechCrunch — AI20 окт.

Исследования#Anthropic#Microsoft1 мин

ENAnthropic’s cloud partnerships are getting messy

Anthropic is reportedly struggling to secure enough compute from cloud providers that increasingly view it as a competitor, even as its infrastructure spending balloons ahead of a planned November IPO.

TechCrunch — AI20 окт.

К списку