33 citations · 88 across the 25 of their papers we have counts for
4 papers · 1 filter
Foundation-Preserving Optimization in Generalized Eigenspace
Dongjun Kim, Adrian de Wynter, Huancheng Chen +2
While finetuning effectively adapts foundation models to specialized downstream tasks, it can degrade nontarget capabilities acquired during pretraining. Existing forgetting aware…
An Approximation Algorithm for Optimal Subarchitecture Extraction
Adrian de Wynter
We consider the problem of finding the set of architectural parameters for a chosen deep neural network which is optimal under three metrics: parameter size, inference speed, and e…
On the Bounds of Function Approximations
Adrian de Wynter
Within machine learning, the subfield of Neural Architecture Search (NAS) has recently garnered research attention due to its ability to improve upon human-designed models. However…
Leveraging External Knowledge for Out-Of-Vocabulary Entity Labeling
Adrian de Wynter, Lambert Mathias
Dealing with previously unseen slots is a challenging problem in a real-world multi-domain dialogue state tracking task. Other approaches rely on predefined mappings to generate ca…