Showing 2024 · cs.LGShow all
2 papers · 2 filters
cs.LG2024
AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation
Yihe Dong
With the rise of language and multimodal models of ever-increasing size, pretraining a general-purpose foundational model and adapting it to downstream tasks has become common prac…
cs.LG2024
Learned Feature Importance Scores for Automated Feature Engineering
Yihe Dong, Sercan Arik, Nathanael Yoder +1
Feature engineering has demonstrated substantial utility for many machine learning workflows, such as in the small data regime or when distribution shifts are severe. Thus automati…