6 papers
Upper-Expectile Multi-Step Q-Learning for Off-Policy Reinforcement Learning
Abdelghani Ghanem, Mounir Ghogho
Multi-step returns accelerate reward propagation in off-policy reinforcement learning, but couple the evaluation of each decision to the suboptimal logged actions that follow it, i…
Physically-Constrained Harmonic Separation for Robust Heart and Respiratory Rate Estimation from Wrist Photoplethysmography
Nouhaila Fraihi, Ouassim Karrakchou, Mounir Ghogho
Wrist-worn photoplethysmography (PPG) enables continuous monitoring of cardiopulmonary physiology, but reliable heart rate (HR) and respiratory rate (RR) estimation in free-living…
Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning
Abdelghani Ghanem, Mounir Ghogho
Integrating expressive generative policies, such as flow-matching models, into offline reinforcement learning (RL) allows agents to capture complex, multi-modal behaviors. While Q-…
Balancing Stability and Plasticity in Sequentially Trained Early-Exiting Neural Networks
Alaa Zniber, Ouassim Karrakchou, Mounir Ghogho
Early-exiting neural networks enable adaptive inference by allowing inputs to exit at intermediate classifiers, reducing computation for easy samples while maintaining high accurac…
Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Accelerators
Alaa Zniber, Arne Symons, Ouassim Karrakchou +2
Deployment of dynamic neural networks on edge accelerators requires careful consideration of hardware constraints beyond conventional complexity metrics such as Multiply-Accumulate…
Incentive Mechanism Design for Privacy-Preserving Decentralized Blockchain Relayers
Boutaina Jebari, Khalil Ibrahimi, Hamidou Tembine +1
Public blockchains, though renowned for their transparency and immutability, suffer from significant privacy concerns. Network-level analysis and long-term observation of publicly…