2 papers
cs.LG2026
Lost in the Middle at Birth: An Exact Theory of Transformer Position Bias
Borun D Chowdhury
The ``Lost in the Middle'' phenomenon -- a U-shaped performance curve where LLMs retrieve well from the beginning and end of a context but fail in the middle -- is widely attribute…
cs.CL2026
FeynTune: Large Language Models for High-Energy Theory
Paul Richmond, Prarit Agarwal, Borun Chowdhury +2
We present specialized Large Language Models for theoretical High-Energy Physics, obtained as 20 fine-tuned variants of the 8-billion parameter Llama-3.1 model. Each variant was tr…