4 papers · 1 filter
Low-Rank Adaptation Redux for Large Models
Bingcong Li, Yilang Zhang, Georgios B. Giannakis
Low-rank adaptation (LoRA) has emerged as the de facto standard for parameter-efficient fine-tuning (PEFT) of foundation models, enabling the adaptation of billion-parameter networ…
Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation
Yilang Zhang, Abraham Jaeger Mountain, Bingcong Li +1
Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks…
Conformalized Gaussian processes for online uncertainty quantification over graphs
Jinwen Xu, Qin Lu, Georgios B. Giannakis
Uncertainty quantification (UQ) over graphs arises in a number of safety-critical applications in network science. The Gaussian process (GP), as a classical Bayesian framework for…
Online scalable Gaussian processes with conformal prediction for guaranteed coverage
Jinwen Xu, Qin Lu, Georgios B. Giannakis
The Gaussian process (GP) is a Bayesian nonparametric paradigm that is widely adopted for uncertainty quantification (UQ) in a number of safety-critical applications, including rob…