Title : ( Policy Iteration Algorithm Based on Experience Replay to Solve H∞ Control Problem of Partially Unknown Nonlinear Systems )
Authors: Sholeh Yasini , Mohammad Bagher Naghibi Sistani , Ali Karimpour ,Access to full-text not allowed by authors
Abstract
In this paper, an online adaptive optimal control algorithm based on policy iteration (PI) is developed to solve the H∞ control problem of partially unknown nonlinear continuous-time (CT) systems. The convergence of existing PI algorithms for solving the H∞ control is guaranteed under the restrictive persistency of excitation (PE) condition. By using the idea of experience replay this condition is relaxed here to a simplified rank condition which is easy to verify online. This is achieved by using previously stored data concurrently with current data for updating the critic NN weights. The proposed algorithm is implemented on actor-critic-disturbance neural network (NN) structure, where all NNs are tuned at the same time to obtain the solution of the Hamilton-Jacobi-Isaacs (HJI) equation, without requiring the information on the internal system dynamics. The stability of the closed-loop system is guaranteed and the convergence to the optimal solution is obtained. Simulation results show the effectiveness of the proposed method.
Keywords
, H∞ Control, Experience Replay, Policy Iteration, Two-player Zero-sum Game@inproceedings{paperid:1044406,
author = {Yasini, Sholeh and Naghibi Sistani, Mohammad Bagher and Karimpour, Ali},
title = {Policy Iteration Algorithm Based on Experience Replay to Solve H∞ Control Problem of Partially Unknown Nonlinear Systems},
booktitle = {13th European Control Conference},
year = {2014},
location = {Strasbourg, french},
keywords = {H∞ Control; Experience Replay; Policy Iteration; Two-player Zero-sum Game},
}
%0 Conference Proceedings
%T Policy Iteration Algorithm Based on Experience Replay to Solve H∞ Control Problem of Partially Unknown Nonlinear Systems
%A Yasini, Sholeh
%A Naghibi Sistani, Mohammad Bagher
%A Karimpour, Ali
%J 13th European Control Conference
%D 2014