We use Chachi PT for [music] all sorts of things, but as researchers, we wanted to know how useful are these models in our everyday lives. [music] We make evals to measure what AI can do. But most of them revolve around workrelated things like coding or math, but there's so much more to life. >> We wanted to make an eval to measure how good AI is at handling your everyday tasks. You know, things to take, [music] remembering, planning, comparing, and following up. So, we created Life Bal, an eval that measures how helpful [music] AI is in everyday life. For example, if you want to help a diabetic parent build a grocery list and plan a week of meals, you don't want a written answer about how to do that. You want actual help getting it done. >> And AI [music] would need to take in a ton of different personal information, health records, dietary preferences, and the budget you have to work with, and then take an action on a grocery delivery website. Lifel helps us measure where the AI model succeeded at the task [music] and where it didn't, and then from there, we can keep improving the models. We care about Chach GPT being [music] useful and that's why we built Life Lifel so we can measure how helpful our models are and make them better for everyday life.
LifeVal: Measuring AI progress on the tasks that matter in everyday life.
We use Chachi PT for [music] all sorts of things, but as researchers, we wanted to know how useful are these models in our everyday lives. [music] We make evals to measure what AI can do. But most of them revolve around workrelated things like coding or math, but there's so much…
AI Summary & Key Takeaways
- We use Chachi PT for [music] all sorts of things, but as researchers, we wanted to know how useful are these models in our everyday lives
- [music] We make evals to measure what AI can do
- But most of them revolve around workrelated things like coding or math, but there's so much…
Related stories
Crusoe sells troubled Wyoming data center project to Google
The deal highlights the challenges of developing massive AI data centers.
OpenAI valued at $1.25 trillion, as rival Anthropic nears its IPO
OpenAI is now valued at $1.25 trillion in a new round of funding that has raised another $11 billion, according to Bloomberg. That would make it one of the world's most valuable companies, not long after raising $122 billion from investors in March at a valuation of $852…
What Does AI Mean for the Future of Human Health? | The Google Research Podcast
Most of what happens in your health happens outside the doctor's office, right? It's happening to you day to day. I know for me, it's hard to remember, "Did I have this symptom four weeks ago, or three weeks ago?" -And it's so true. Right? Most of how you experience your…
Anthropics Model 4 Just Shocked The AI Industry
An independent research group was just given rare access inside Anthropic. And what it found has a lot of AI researchers genuinely worried. According to MER, Anthropic is now improving its AI models at roughly twice the speed it was just a year ago. And most of that speed up…



