activity
20202026
most citedGetting More Juice Out of the SFT Data: Reward Learning from Human Demonstration Improves SFT for LLM Alignment

1 citations · 2 across the 13 of their papers we have counts for

collaborators
Showing math.OCShow all

7 papers · 1 filter

math.OC2025

Federated Learning on Riemannian Manifolds: A Gradient-Free Projection-Based Approach

Hongye Wang, Zhaoye Pan, Chang He +2

Federated learning (FL) has emerged as a powerful paradigm for collaborative model training across distributed clients while preserving data privacy. However, existing FL algorithm…

math.OC2025

On Relatively Smooth Optimization over Riemannian Manifolds

Chang He, Jiaxiang Li, Bo Jiang +2

We study optimization over Riemannian embedded submanifolds, where the objective function is relatively smooth in the ambient Euclidean space. Such problems have broad applications…

math.OC2024

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization

Jiaxiang Li, Xuxing Chen, Shiqian Ma +1

Existing decentralized algorithms usually require knowledge of problem parameters for updating local iterates. For example, the hyperparameters (such as learning rate) usually requ…

math.OC2024

Riemannian Bilevel Optimization

Jiaxiang Li, Shiqian Ma

In this work, we consider the bilevel optimization problem on Riemannian manifolds. We inspect the calculation of the hypergradient of such problems on general manifolds and thus e…

math.OC2023

Zeroth-order Riemannian Averaging Stochastic Approximation Algorithms

Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma

We present Zeroth-order Riemannian Averaging Stochastic Approximation (\texttt{Zo-RASA}) algorithms for stochastic optimization on Riemannian manifolds. We show that \texttt{Zo-RAS…

math.OC2022

A Riemannian ADMM

Jiaxiang Li, Shiqian Ma, Tejes Srivastava

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of…

math.OC2020★ 1 cited

Stochastic Zeroth-order Riemannian Derivative Estimation and Optimization

Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma

We consider stochastic zeroth-order optimization over Riemannian submanifolds embedded in Euclidean space, where the task is to solve Riemannian optimization problem with only nois…