4 papers
Data coarse graining can improve model performance
Alex Nguyen, David J. Schwab, Vudtiwat Ngampruetikorn
Lossy data transformations by definition lose information. Yet, in modern machine learning, methods like data pruning and lossy data augmentation can help improve generalization pe…
Lucy: edgerunning agentic web search on mobile with machine generated task vectors
Alan Dao, Dinh Bach Vu, Alex Nguyen +1
Small language models (SLMs) are inherently limited in knowledge-intensive tasks due to their constrained capacity. While test-time computation offers a path to enhanced performanc…
Differential learning kinetics govern the transition from memorization to generalization during in-context learning
Alex Nguyen, Gautam Reddy
Transformers exhibit in-context learning (ICL): the ability to use novel information presented in the context without additional weight updates. Recent work shows that ICL emerges…
Generalization vs. Specialization under Concept Shift
Alex Nguyen, David J. Schwab, Vudtiwat Ngampruetikorn
Machine learning models are often brittle under distribution shift, i.e., when data distributions at test time differ from those during training. Understanding this failure mode is…