Table Serialization Determines Which Relations Language Models Preserve

Junwei Ma, Arun Kumar Chithanar, Palash Goyal +1

We study how text serialization affects table lookup in instruction-tuned language models. Our diagnostic asks the model to find the row containing a specified value under one name…