42 citations · 197 across the 45 of their papers we have counts for
4 papers · 1 filter
Optimal Local Convergence Rates of Stochastic First-Order Methods under Local -PL
Saeed Masiha, Saber Salehkaleybar, Niao He +2
We study the local convergence rate of stochastic first-order methods under a local -Polyak-Lojasiewicz (-PL) condition in a neighborhood of a target connected component $\ma…
Causal Effect Identification in LiNGAM Models with Latent Confounders
Daniele Tramontano, Yaroslav Kivva, Saber Salehkaleybar +2
We study the generic identifiability of causal effects in linear non-Gaussian acyclic models (LiNGAM) with latent variables. We consider the problem in two main settings: When the…
Soft Preference Optimization: Aligning Language Models to Expert Distributions
Arsalan Sharifnassab, Saber Salehkaleybar, Sina Ghiassian +2
We propose Soft Preference Optimization (SPO), a method for aligning generative models, such as Large Language Models (LLMs), with human preferences, without the need for a reward…
MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters
Arsalan Sharifnassab, Saber Salehkaleybar, Richard Sutton
We address the challenge of optimizing meta-parameters (hyperparameters) in machine learning, a key factor for efficient training and high model performance. Rather than relying on…