11 citations · 31 across the 16 of their papers we have counts for
5 papers · 1 filter
Indoor Air Quality Dataset with Activities of Daily Living in Low to Middle-income Communities
Prasenjit Karmakar, Swadhin Pradhan, Sandip Chakraborty
In recent years, indoor air pollution has posed a significant threat to our society, claiming over 3.2 million lives annually. Developing nations, such as India, are most affected…
Exploiting Multi-modal Contextual Sensing for City-bus's Stay Location Characterization: Towards Sub-60 Seconds Accurate Arrival Time Prediction
Ratna Mandal, Prasenjit Karmakar, Soumyajit Chatterjee +5
Intelligent city transportation systems are one of the core infrastructures of a smart city. The true ingenuity of such an infrastructure lies in providing the commuters with real-…
Stochastic Approximation with Markov Noise: Analysis and applications in reinforcement learning
Prasenjit Karmakar
We present for the first time an asymptotic convergence analysis of two time-scale stochastic approximation driven by "controlled" Markov noise. In particular, the faster and slowe…
On the function approximation error for risk-sensitive reinforcement learning
Prasenjit Karmakar, Shalabh Bhatnagar
In this paper we obtain several informative error bounds on function approximation for the policy evaluation algorithm proposed by Basu et al. when the aim is to find the risk-sens…
On a convergent off -policy temporal difference learning algorithm in on-line learning environment
Prasenjit Karmakar, Rajkumar Maity, Shalabh Bhatnagar
In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear comput…