activity
19982023
most citedMetrics for Finite Markov Decision Processes

54 citations · 493 across the 45 of their papers we have counts for

collaborators

50 papers

cs.FL2023★ 1 cited

Optimal Approximate Minimization of One-Letter Weighted Finite Automata

Clara Lacroce, Borja Balle, Prakash Panangaden +1

In this paper, we study the approximate minimization problem of weighted finite automata (WFAs): to compute the best possible approximation of a WFA given a bound on the number of…

cs.LG2023★ 1 cited

Policy Gradient Methods in the Presence of Symmetries and State Abstractions

Prakash Panangaden, Sahand Rezaei-Shoshtari, Rosie Zhao +2

Reinforcement learning (RL) on high-dimensional and complex problems relies on abstraction for improved efficiency and generalization. In this paper, we study abstraction in the co…

cs.LO2023★ 3 cited

Propositional Logics for the Lawvere Quantale

Giorgio Bacci, Radu Mardare, Prakash Panangaden +1

Lawvere showed that generalised metric spaces are categories enriched over , the quantale of the positive extended reals. The statement of enrichment is a quantitative…

cs.LO2022★ 1 cited

Sum and Tensor of Quantitative Effects

Giorgio Bacci, Radu Mardare, Prakash Panangaden +1

Inspired by the seminal work of Hyland, Plotkin, and Power on the combination of algebraic computational effects via sum and tensor, we develop an analogous theory for the combinat…

cs.LG2022

Continuous MDP Homomorphisms and Homomorphic Policy Gradient

Sahand Rezaei-Shoshtari, Rosie Zhao, Prakash Panangaden +2

Abstraction has been widely studied as a way to improve the efficiency and generalization of reinforcement learning algorithms. In this paper, we study abstraction in the continuou…

cs.LG2022★ 14 cited

Riemannian Diffusion Models

Chin-Wei Huang, Milad Aghajohari, Avishek Joey Bose +2

Diffusion models are recent state-of-the-art methods for image generation and likelihood estimation. In this work, we generalize continuous-time diffusion models to arbitrary Riema…