activity
20192026
most citedApproximate information state for approximate planning and reinforcement learning in partially observed systems

17 citations · 29 across the 11 of their papers we have counts for

collaborators

11 papers

cs.LG2026

Heterogeneous Decentralized Diffusion Models

Zhiying Jiang, Raihan Seraj, Marcos Villagra +1

Training frontier-scale diffusion models often requires substantial computational resources concentrated in tightly-coupled clusters, limiting participation to well-resourced insti…

cs.LG2026

Expert-Data Alignment Governs Generation Quality in Decentralized Diffusion Models

Marcos Villagra, Bidhan Roy, Raihan Seraj +1

Decentralized Diffusion Models (DDMs) route denoising through experts trained independently on disjoint data clusters, which can strongly disagree in their predictions. What govern…

cs.GR2025

Paris: A Decentralized Trained Open-Weight Diffusion Model

Zhiying Jiang, Raihan Seraj, Marcos Villagra +1

We present Paris, the first publicly released diffusion model pre-trained entirely through decentralized computation. Paris demonstrates that high-quality text-to-image generation…

cs.AI2025

Contextual bandits with entropy-based human feedback

Raihan Seraj, Lili Meng, Tristan Sylvain

In recent years, preference-based human feedback mechanisms have become essential for enhancing model performance across diverse applications, including conversational AI systems s…

cs.LG2024

Generalizing Multi-Step Inverse Models for Representation Learning to Finite-Memory POMDPs

Lili Wu, Ben Evans, Riashat Islam +3

Discovering an informative, or agent-centric, state representation that encodes only the relevant information while discarding the irrelevant is a key challenge towards scaling rei…

cs.LG2023

PcLast: Discovering Plannable Continuous Latent States

Anurag Koul, Shivakanth Sujit, Shaoru Chen +11

Goal-conditioned planning benefits from learned low-dimensional representations of rich observations. While compact latent representations typically learned from variational autoen…

cs.LG2023

AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrieval

Qi Yan, Raihan Seraj, Jiawei He +2

Machine-based prediction of real-world events is garnering attention due to its potential for informed decision-making. Whereas traditional forecasting predominantly hinges on stru…

cs.LG2022★ 5 cited

Tsetlin Machine for Solving Contextual Bandit Problems

Raihan Seraj, Jivitesh Sharma, Ole-Christoffer Granmo

This paper introduces an interpretable contextual bandit algorithm using Tsetlin Machines, which solves complex pattern recognition tasks using propositional logic. The proposed ba…

cs.LG2020★ 17 cited

Approximate information state for approximate planning and reinforcement learning in partially observed systems

Jayakumar Subramanian, Amit Sinha, Raihan Seraj +1

We propose a theoretical framework for approximate planning and learning in partially observed systems. Our framework is based on the fundamental notion of information state. We pr…

cs.LG2019

Doubly Robust Off-Policy Actor-Critic Algorithms for Reinforcement Learning

Riashat Islam, Raihan Seraj, Samin Yeasar Arnob +1

We study the problem of off-policy critic evaluation in several variants of value-based off-policy actor-critic algorithms. Off-policy actor-critic algorithms require an off-policy…

cs.LG2019★ 7 cited

Entropy Regularization with Discounted Future State Distribution in Policy Gradient Methods

Riashat Islam, Raihan Seraj, Pierre-Luc Bacon +1

The policy gradient theorem is defined based on an objective with respect to the initial distribution over states. In the discounted case, this results in policies that are optimal…