# CARAT: Do Materials LLMs Reason or Recite?

**Published:** October 1, 2026
**Author:** Jiajun Wu, Jian Yang, Zixiang Ni, Zhenzhu Li, Bin Chong
**Source:** arXiv — cs.AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/carat-do-materials-llms-reason-or-recite

When a materials LLM answers a question about crystal structure, does it reason from the structure or copy an answer already printed in its input? Accuracy cannot tell: a structural description often prints the very field it is scored against. CARAT holds question and gold…

> From the original source: **arXiv — cs.AI**
> [Read full article at arXiv — cs.AI](https://arxiv.org/abs/2609.38340)

**Tags:** #arXiv

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*