A Comparative Study of Learning Paradigms in Large Language Models via Intrinsic Dimension

Saahith Janapati, Yangfeng Ji

The performance of Large Language Models (LLMs) on natural language tasks can be improved through both supervised fine-tuning (SFT) and in-context learning (ICL), which operate via…