🧬 ИИ-агентов начали проверять на способность работать с настоящими лабораторными данными Совместно с биотехнологической компанией Ligo разработали новый бенчмарк BioBasicsBench, который оценивает, насколько хорошо нейросети справляются с повседневными задачами биологических исследований. В основе теста — 100 заданий из реальных лабораторных экспериментов. ИИ-агентам предстоит анализировать исходные данные, находить ошибки и определять, когда результатов недостаточно для научных выводов. Разработчики рассчитывают, что BioBasicsBench поможет отслеживать прогресс ИИ в научных исследованиях и оценивать связанные с ним риски биобезопасности. Источник
From the original source:
Telegram — GPT Time | Нейросети | ИИ
Read full article at Telegram — GPT Time | Нейросети | ИИAI agents are being tested for their ability to work with real laboratory data
🧬 AI agents are being tested for their ability to work with real laboratory data. In collaboration with biotech company Ligo, a new benchmark BioBasicsBench has been developed, which evaluates how well neural networks handle everyday biological tasks…
AI Summary & Key Takeaways
- 🧬 AI agents are being tested for their ability to work with real laboratory data
- In collaboration with biotech company Ligo, a new benchmark BioBasicsBench has been developed, which evaluates how well neural networks handle everyday biological tasks…
AI agents are being tested for their ability to work with real laboratory data
Related stories
World Models Will Soon Be Inescapable. Here’s What You Need to Know
Moving AI from text to 3D space, world models simulate real-world physics to teach robots and autonomous cars how to navigate reality.
AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test
Alibaba's new coding-agent benchmark, Co-Design Bench, tests AI agents on real user requests that already tripped them up in practice. Even GPT-6 Astra, the top performer, fully solves only 26.4 percent of tasks. On older benchmarks, the same models score above 99 percent. The…
Testing OpenAI and Anthropic models on social deduction
📌 Testing OpenAI and Anthropic models on social deduction. Podcaster Dwarkesh Patel spent $20,000 on API to organize a tournament among 11 models playing Blood on the Clocktower, a more complex analogue of Mafia. 🟡Game rules: The whole point is the struggle for information. Participants…
Neural networks are accessible to everyone. Why does business keep paying specialists?
Neural networks are accessible to everyone. Why does business keep paying specialists? Knowing how to use ChatGPT is already a weak specialization. Companies pay for results you can ask about: the program works, leads aren't lost, advertising delivers measurable impact. A beautiful demo…
