Exploring Next Token Prediction in Theory of Mind (ToM) Tasks: Comparative Experiments with GPT-2 and LLaMA-2 AI Models

Pavan Yadav, Nikhil Khandalkar, Krishna Shinde +2

Language models have made significant progress in generating coherent text and predicting next tokens based on input prompts. This study compares the next-token prediction performa…