activity
20112021
most citedDiff-DAC: Distributed Actor-Critic for Average Multitask Deep Reinforcement Learning

29 citations · 55 across the 9 of their papers we have counts for

collaborators

10 papers

math.OC2021

Strong Duality in Nonconvex Quadratic Problems with Separable Quadratic Constraints

Javier Zazo, Santiago Zazo

We study nonconvex quadratic problems (QPs) with quadratic separable constraints, where these constraints can be defined both as inequalities or equalities. We derive sufficient co…

cs.MA2018★ 7 cited

Learning Parametric Closed-Loop Policies for Markov Potential Games

Sergio Valcarcel Macua, Javier Zazo, Santiago Zazo

Multiagent systems where agents interact among themselves and with a stochastic environment can be formalized as stochastic games. We study a subclass named Markov potential games…

cs.LG2017★ 29 cited

Diff-DAC: Distributed Actor-Critic for Average Multitask Deep Reinforcement Learning

Sergio Valcarcel Macua, Aleksi Tukiainen, Daniel García-Ocaña Hernández +3

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinfo…

physics.ao-ph2016

Investigation on Radio Wave Propagation in Shallow Seawater: Simulations and Measurements

Eugenio Jimenez, Gara Quintana, Pablo Mena +5

The authors present full wave simulations and experimental results of propagation of electromagnetic waves in shallow seawaters. Transmitter and receiver antennas are ten-turns loo…

cs.NI2016★ 4 cited

Cooperative Network Node Positioning Techniques Using Underwater Radio Communications

Javier Zazo, Santiago Zazo, Sergio Valcarcel Macua +4

We analyze the problem of localization algorithms for underwater sensor networks. We first characterize the underwater channel for radio communications and adjust a linear model wi…

cs.NI2016★ 2 cited

Simulation of Underwater RF Wireless Sensor Networks using Castalia

Sergio Valcarcel Macua, Santiago Zazo, Javier Zazo +4

We use real measurements of the underwater channel to simulate a whole underwater RF wireless sensor networks, including propagation impairments (e.g., noise, interference), radio…

eess.SY2015★ 6 cited

Dynamic Potential Games in Communications: Fundamentals and Applications

Santiago Zazo, Sergio Valcarcel Macua, Matilde Sánchez-Fernández +1

In a noncooperative dynamic game, multiple agents operating in a changing environment aim to optimize their utilities over an infinite time horizon. Time-varying environments allow…

cs.MA2013

Distributed Policy Evaluation Under Multiple Behavior Strategies

Sergio Valcarcel Macua, Jianshu Chen, Santiago Zazo +1

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbo…

cs.DC2012★ 5 cited

Belief Consensus Algorithms for Fast Distributed Target Tracking in Wireless Sensor Networks

Vladimir Savic, Henk Wymeersch, Santiago Zazo

In distributed target tracking for wireless sensor networks, agreement on the target state can be achieved by the construction and maintenance of a communication path, in order to…

cs.NI2011★ 2 cited

Location-aided Distributed Primary User Identification in a Cognitive Radio Scenario

Pavle Belanovic, Sergio Valcarcel Macua, Santiago Zazo

We address a cognitive radio scenario, where a number of secondary users performs identification of which primary user, if any, is transmitting, in a distributed way and using limi…