5 papers · 1 filter
Fine-Tuning Diffusion Models via Intermediate Distribution Shaping
Gautham Govind Anil, Shaan Ul Haque, Nithish Kannen +3
Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for error…
Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
Shaan Ul Haque, Siva Theja Maguluri
Motivated by engineering applications such as resource allocation in networks and inventory systems, we consider average-reward Reinforcement Learning with unbounded state space an…
Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
Siddharth Chandak, Shaan Ul Haque, Nicholas Bambos
Two-time-scale Stochastic Approximation (SA) is an iterative algorithm with applications in reinforcement learning and optimization. Prior finite time analysis of such algorithms h…
Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
Shaan Ul Haque, Sajad Khodadadian, Siva Theja Maguluri
Stochastic approximation (SA) is an iterative algorithm for finding the fixed point of an operator using noisy samples and widely used in optimization and Reinforcement Learning (R…
A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms
Zaiwei Chen, Sheng Zhang, Zhe Zhang +2
We study the problem of solving fixed-point equations for seminorm-contractive operators and establish foundational results on the non-asymptotic behavior of iterative algorithms i…