Do Multilingual LLMs Think In English?

Lisa Schut, Yarin Gal, Sebastian Farquhar

Large language models (LLMs) have multilingual capabilities and can solve tasks across various languages. However, we show that current LLMs make key decisions in a representation…