On the logical skills of large language models: evaluations using arbitrarily complex first-order logic problems

Shokhrukh Ibragimov, Arnulf Jentzen, Benno Kuckuck

We present a method of generating first-order logic statements whose complexity can be controlled along multiple dimensions. We use this method to automatically create several data…