2 papers
cs.CL2026
Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective
Bishwamittra Ghosh, Soumi Das, Till Speicher +5
Large language models (LLMs) operate in two fundamental learning modes - fine-tuning (FT) and in-context learning (ICL) - raising key questions about which mode yields greater lang…
cs.LG2025
Understanding the Interplay between Memorization and Learning in Large Language Models
Bishwamittra Ghosh, Soumi Das, Qinyuan Wu +4
We investigate foundational questions about the interplay between memorization and learning in large language models (LLMs). When an LLM generates a string, can we disentangle the…