CARAT: Do Materials LLMs Reason or Recite?

Jiajun Wu, Jian Yang, Zixiang Ni +2

When a materials LLM answers a question about crystal structure, does it reason from the structure or copy an answer already printed in its input? Accuracy cannot tell: a structura…