From the 1 of 5 linked papers with an AI index.
5 papers
Training-Free versus Training-Based Intent Classification in LLMs: Accuracy, Robustness, and Failure Modes
Nan Chen, Zhouhao Yang, Soufiane Hayou
Intent classification in Large Language Models (LLMs) involves categorizing user prompts into predefined classes. For instance, given a user prompt, the system must determine wheth…
Heavy-Tailed Flow Matching via Random Clocks
Zhouhao Yang, Yezhen Wang, Kenji Kawaguchi +2
The paper introduces Heavy-Tailed Flow Matching via Random Clocks (HTFM), a method that models heavy‑tailed source distributions as mixtures of Gaussian flows conditioned on random…
Statistical Mean Estimation with Coded Relayed Observations
Yan Hao Ling, Zhouhao Yang, Jonathan Scarlett
We consider a problem of statistical mean estimation in which the samples are not observed directly, but are instead observed by a relay (``teacher'') that transmits information th…
Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients
Yezhen Wang, Zhouhao Yang, Brian K Chen +4
Building upon the success of low-rank adapter (LoRA), low-rank gradient projection (LoRP) has emerged as a promising solution for memory-efficient fine-tuning. However, existing Lo…
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
Qianli Shen, Yezhen Wang, Zhouhao Yang +6
Bi-level optimization (BO) has become a fundamental mathematical framework for addressing hierarchical machine learning problems. As deep learning models continue to grow in size,…