Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification

Thanushon Sivakaran, En-Hui Yang

Although large language models (LLMs) have demonstrated remarkable capabilities in recent years, the potential of information theory (IT) to enhance LLM development remains underex…