23 citations · 129 across the 43 of their papers we have counts for
50 papers
Teaching LLMs to Generate Challenging MILP Instances via Solver Feedback
Jitin Singla, Parikshit Pareek, Pratik Jawanpuria +1
Generating optimization instances that are both feasible and computationally challenging is crucial for benchmarking solvers and training learning-based optimization algorithms. Ex…
Optimization over covariance matrices with a parameterized metric
Yibang Li, Bamdev Mishra, Pratik Jawanpuria +1
The choice of Riemannian metric can strongly influence the convergence of gradient-based optimization over covariance matrices. Euclidean, Bures-Wasserstein and affine-invariant me…
A Riemannian Approach to Low-Rank Optimal Transport
Pratik Jawanpuria, Bamdev Mishra
Low-rank optimal transport (OT) mitigates the quadratic scaling of classical solvers, yet existing approaches rely heavily on first-order mirror-descent updates that require carefu…
Minibatch Selection for Language Models via Partition Matroid Constrained Gradient Matching
Prayas Agrawal, Prateek Chanda, Ishita Khatri +3
Training large language models (LLMs) on heterogeneous data requires selecting minibatches that balance convergence speed with coverage across domains. Existing methods either sele…
Riemannian Optimization for Hadamard Products of Low-Rank Matrices
Pratik Jawanpuria, Ankish Chandresh, Bamdev Mishra
The elementwise Hadamard product of two low-rank matrices provides a parameter-efficient model for data with multiplicative structure, but its modeling is challenging due to the pr…
Nyström Approximation on Manifolds
Hantao Nie, Bin Gao, Andi Han +3
Computations on a manifold often involve constructing an operator on the tangent space and computing its inverse, which can be time-consuming in many applications. In order to redu…
LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection
Lanxin Zhao, Bamdev Mishra, Pratik Jawanpuria +4
Orthogonal parameter-efficient fine-tuning (PEFT) adapts pretrained weights through structure-preserving multiplicative transformations, but existing methods often conflate two dis…
Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds
Yibang Li, Bihari Lal Pandey, Ravi Sah +4
Muon and related norm-constrained matrix optimizers have become central to large-scale learning problems. They are formulated as a linear maximization oracle (LMO) over an ambient…
FedSEA: Achieving Benefit of Parallelization in Federated Online Learning
Harekrushna Sahu, Pratik Jawanpuria, Pranay Sharma
Online federated learning (OFL) has emerged as a popular framework for decentralized decision-making over continuous data streams without compromising client privacy. However, the…
UniPROT: Uniform Prototype Selection via Partial Optimal Transport with Submodular Guarantees
Prateek Chanda, Prayas Agrawal, Karthik S. Gurumoorthy +3
Selecting prototypical examples from a source distribution to represent a target data distribution is a fundamental problem in machine learning. Existing subset selection methods o…
Generalized infinite dimensional Alpha-Procrustes based geometries
Salvish Goomanee, Andi Han, Pratik Jawanpuria +1
This work extends the recently introduced Alpha-Procrustes family of Riemannian metrics for symmetric positive definite (SPD) matrices by incorporating generalized versions of the…
A Riemannian Approach to Ground Metric Learning for Optimal Transport
Pratik Jawanpuria, Dai Shi, Bamdev Mishra +1
Optimal transport (OT) theory has attracted much attention in machine learning and signal processing applications. OT defines a notion of distance between probability distributions…
Riemannian Federated Learning via Averaging Gradient Streams
Zhenwei Huang, Wen Huang, Pratik Jawanpuria +1
Federated learning (FL) as a distributed learning paradigm has a significant advantage in addressing large-scale machine learning tasks. In the Euclidean setting, FL algorithms hav…
Riemannian coordinate descent algorithms on matrix manifolds
Andi Han, Pratik Jawanpuria, Bamdev Mishra
Many machine learning applications are naturally formulated as optimization problems on Riemannian manifolds. The main idea behind Riemannian optimization is to maintain the feasib…
Submodular Framework for Structured-Sparse Optimal Transport
Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy +2
Unbalanced optimal transport (UOT) has recently gained much attention due to its flexible framework for handling un-normalized measures and its robustness properties. In this work,…
SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining
Andi Han, Jiaxiang Li, Wei Huang +4
Large language models (LLMs) have shown impressive capabilities across various tasks. However, training LLMs from scratch requires significant computational power and extensive mem…
Federated Learning on Riemannian Manifolds with Differential Privacy
Zhenwei Huang, Wen Huang, Pratik Jawanpuria +1
In recent years, federated learning (FL) has emerged as a prominent paradigm in distributed machine learning. Despite the partial safeguarding of agents' information within FL syst…
A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial Networks
Neel Mishra, Bamdev Mishra, Pratik Jawanpuria +1
A novel first-order method is proposed for training generative adversarial networks (GANs). It modifies the Gauss-Newton method to approximate the min-max Hessian and uses the Sher…
A Framework for Bilevel Optimization on Riemannian Manifolds
Andi Han, Bamdev Mishra, Pratik Jawanpuria +1
Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both t…
Light-weight Deep Extreme Multilabel Classification
Istasis Mishra, Arpan Dasgupta, Pratik Jawanpuria +2
Extreme multi-label (XML) classification refers to the task of supervised multi-label learning that involves a large number of labels. Hence, scalability of the classifier with inc…
Generalised Spherical Text Embedding
Souvik Banerjee, Bamdev Mishra, Pratik Jawanpuria +1
This paper aims to provide an unsupervised modelling approach that allows for a more flexible representation of text embeddings. It jointly encodes the words and the paragraphs as…
Rieoptax: Riemannian Optimization in JAX
Saiteja Utpala, Andi Han, Pratik Jawanpuria +1
We present Rieoptax, an open source Python library for Riemannian optimization in JAX. We show that many differential geometric primitives, such as Riemannian exponential and logar…
ProtoBandit: Efficient Prototype Selection via Multi-Armed Bandits
Arghya Roy Chaudhuri, Pratik Jawanpuria, Bamdev Mishra
In this work, we propose a multi-armed bandit-based framework for identifying a compact set of informative data instances (i.e., the prototypes) from a source dataset that best…
Riemannian accelerated gradient methods via extrapolation
Andi Han, Bamdev Mishra, Pratik Jawanpuria +1
In this paper, we propose a simple acceleration scheme for Riemannian gradient methods by extrapolating iterates on manifolds. We show when the iterates are generated from Riemanni…