Rapid LLM development is outrunning the research meant to explain it, study finds
Stanford researchers tested 50 widely cited claims about LLMs against 20 current models. 44 percent of the findings are already "expired," and another 34 percent have weakened significantly. The average lifespan is just 15.7 months. Claims about what models can't do expire…
AI Summary & Key Takeaways
- Stanford researchers tested 50 widely cited claims about LLMs against 20 current models
- 44 percent of the findings are already "expired," and another 34 percent have weakened significantly
- The average lifespan is just 15.7 months
Rapid LLM development is outrunning the research meant to explain it, study finds
Related stories
ChatGPT can now turn text prompts and photos into animated GIFs with OpenAI's Images 2.6 model
OpenAI is adding a GIF feature to ChatGPT. With the new Images 2.6 model, users can create animated GIFs from text prompts or photos and then adjust speed and individual frames. The model's image consistency is strong enough to keep characters recognizable across frames, making…
Open source AI is booming. Hugging Face explains who profits.
Open source models are becoming more mainstream as enterprises, governments and startups alike rely on the promise of lower costs, more control, and more flexibility. But as increasingly capable models become more freely available, how do companies capture value? And with…
Hugging Face’s CEO Says His P(Doom) Is ‘Close to Zero’
“Most of the risk is actually created by a couple of players building behind closed doors,” Clément Delangue said of the need for open source AI.
Anthropic's text watermark is easy to bypass on several older Claude models
Anthropic is rolling out text watermarks to four more Claude models ahead of the EU AI Act's December deadline. But on older models like Claude Opus 4.6 and Sonnet 4.6, API users can disable the watermark by changing a single sampling parameter. Anthropic's response to the…