activity
20122021
most citedProbably Approximately Correct MDP Learning and Control With Temporal Logic Constraints

63 citations · 188 across the 23 of their papers we have counts for

collaborators

24 papers

cs.GT2021

Synthesis of Deceptive Strategies in Reachability Games with Action Misperception (Technical Report)

Abhishek N. Kulkarni, Jie Fu

Strategic deception is an act of manipulating the opponent's perception to gain strategic advantages. In this paper, we study synthesis of deceptive winning strategies in two-playe…

cs.GT2020

Decoy Allocation Games on Graphs with Temporal Logic Objectives

Abhishek N. Kulkarni, Jie Fu, Huan Luo +2

We study a class of games, in which the adversary (attacker) is to satisfy a complex mission specified in linear temporal logic, and the defender is to prevent the adversary from a…

cs.CR2020

A Theory of Hypergames on Graphs for Synthesizing Dynamic Cyber Defense with Deception

Abhishek N. Kulkarni, Jie Fu

In this chapter, we present an approach using formal methods to synthesize reactive defense strategy in a cyber network, equipped with a set of decoy systems. We first generalize f…

cs.GT2020

Dynamic Hypergames for Synthesis of Deceptive Strategies with Temporal Logic Objectives

Lening Li, Haoxiang Ma, Abhishek N. Kulkarni +1

In this paper, we study the use of deception for strategic planning in adversarial environments. We model the interaction between the agent (player 1) and the adversary (player 2)…

cs.GT2020★ 11 cited

Deceptive Labeling: Hypergames on Graphs for Stealthy Deception

Abhishek N. Kulkarni, Huan Luo, Nandi O. Leslie +2

With the increasing sophistication of attacks on cyber-physical systems, deception has emerged as an effective tool to improve system security and safety by obfuscating the attacke…

cs.GT2020★ 1 cited

Synthesis of Deceptive Strategies in Reachability Games with Action Misperception

Abhishek N. Kulkarni, Jie Fu

We consider a class of two-player turn-based zero-sum games on graphs with reachability objectives, known as reachability games, where the objective of Player 1 (P1) is to reach a…

cs.GT2020

Secure-by-synthesis network with active deception and temporal logic specifications

Jie Fu, Abhishek N. Kulkarni, Huan Luo +2

This paper is concerned with the synthesis of strategies in network systems with active cyber deception. Active deception in a network employs decoy systems and other defenses to c…

cs.CR2020

A Receding-Horizon MDP Approach for Performance Evaluation of Moving Target Defense in Networks

Zhentian Qian, Jie Fu, Quanyan Zhu

In this paper, we study the problem of assessing the effectiveness of a proactive defense-by-detection policy with a network-based moving target defense. We model the network syste…

math.OC2019★ 1 cited

Topological Approximate Dynamic Programming under Temporal Logic Constraints

Lening Li, Jie Fu

In this paper, we develop a Topological Approximate Dynamic Programming (TADP) method for planningin stochastic systems modeled as Markov Decision Processesto maximize the probabil…

cs.FL2019★ 3 cited

Opportunistic Synthesis in Reactive Games under Information Asymmetry

Abhishek N. Kulkarni, Jie Fu

Reactive synthesis is a class of methods to construct a provably-correct control system, referred to as a robot, with respect to a temporal logic specification in the presence of a…

cs.RO2019

A Validated Physical Model For Real-Time Simulation of Soft Robotic Snakes

Renato Gasoto, Miles Macklin, Xuan Liu +4

In this work we present a framework that is capable of accurately representing soft robotic actuators in a multiphysics environment in real-time. We propose a constraint-based dyna…

math.OC2018★ 1 cited

Compositional planning in Markov decision processes: Temporal abstraction meets generalized logic composition

Xuan Liu, Jie Fu

In hierarchical planning for Markov decision processes (MDPs), temporal abstraction allows planning with macro-actions that take place at different time scale in form of sequential…

eess.SY2018★ 6 cited

Minimum Violation Control Synthesis on Cyber-Physical Systems under Attacks

Luyao Niu, Jie Fu, Andrew Clark

Cyber-physical systems are conducting increasingly complex tasks, which are often modeled using formal languages such as temporal logic. The system's ability to perform the require…

cs.AI2018

Human-in-the-Loop Synthesis for Partially Observable Markov Decision Processes

Steven Carr, Nils Jansen, Ralf Wimmer +2

We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision proc…

cs.AI2017★ 61 cited

Environment-Independent Task Specifications via GLTL

Michael L. Littman, Ufuk Topcu, Jie Fu +3

We propose a new task-specification language for Markov decision processes that is designed to be an improvement over reward functions by being environment independent. The languag…

eess.SY2016

Importance sampling-based approximate optimal planning and control

Jie Fu

In this paper, we propose a sampling-based planning and optimal control method of nonlinear systems under non-differentiable constraints. Motivated by developing scalable planning…

cs.RO2015★ 31 cited

Optimal Temporal Logic Planning in Probabilistic Semantic Maps

Jie Fu, Nikolay Atanasov, Ufuk Topcu +1

This paper considers robot motion planning under temporal logic constraints in probabilistic maps obtained by semantic simultaneous localization and mapping (SLAM). The uncertainty…

eess.SY2015★ 4 cited

Computational methods for stochastic control with metric interval temporal logic specifications

Jie Fu, Ufuk Topcu

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic sp…

eess.SY2015★ 3 cited

Optimal control in Markov decision processes via distributed optimization

Jie Fu, Shuo Han, Ufuk Topcu

Optimal control synthesis in stochastic systems with respect to quantitative temporal logic constraints can be formulated as linear programming problems. However, centralized synth…

cs.RO2014

Pareto efficiency in synthesizing shared autonomy policies with temporal logic constraints

Jie Fu, Ufuk Topcu

In systems in which control authority is shared by an autonomous controller and a human operator, it is important to find solutions that achieve a desirable system performance with…

eess.SY2014★ 3 cited

Integrating active sensing into reactive synthesis with temporal logic constraints under partial observations

Jie Fu, Ufuk Topcu

We introduce the notion of online reactive planning with sensing actions for systems with temporal logic constraints in partially observable and dynamic environments. With incomple…

eess.SY2014

Abstractions and sensor design in partial-information, reactive controller synthesis

Jie Fu, Rayna Dimitrova, Ufuk Topcu

Automated synthesis of reactive control protocols from temporal logic specifications has recently attracted considerable attention in various applications in, for example, robotic…

eess.SY2014★ 63 cited

Probably Approximately Correct MDP Learning and Control With Temporal Logic Constraints

Jie Fu, Ufuk Topcu

We consider synthesis of control policies that maximize the probability of satisfying given temporal logic specifications in unknown, stochastic environments. We model the interact…

cs.RO2012

Symbolic Planning and Control Using Game Theory and Grammatical Inference

Jie Fu, Herbert G. Tanner, Jeffrey Heinz +3

This paper presents an approach that brings together game theory with grammatical inference and discrete abstractions in order to synthesize control strategies for hybrid dynamical…