2 papers
cs.LG2025
Progress over Points: Reframing LM Benchmarks Around Scientific Objectives
Alwin Jin, Sean M. Hendryx, Vaskar Nath
Current benchmarks that test LLMs on static, already-solved problems (e.g., math word problems) effectively demonstrated basic capability acquisition. The natural progression has b…
cs.CL2024
LEGO: Language Model Building Blocks
Shrenik Bhansali, Alwin Jin, Tyler Lizzo +1
Large language models (LLMs) are essential in natural language processing (NLP) but are costly in data collection, pre-training, fine-tuning, and inference. Task-specific small lan…