Read e-book online Adaptive Dynamic Programming with Applications in Optimal PDF

By Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li

ISBN-10: 331950813X

ISBN-13: 9783319508139

ISBN-10: 3319508156

ISBN-13: 9783319508153

This publication covers the newest advancements in adaptive dynamic programming (ADP). The textual content starts with a radical heritage evaluation of ADP to ensure that readers are sufficiently conversant in the basics. within the center of the publication, the authors handle first discrete- after which continuous-time platforms. assurance of discrete-time platforms begins with a extra normal type of worth new release to illustrate its convergence, optimality, and balance with entire and thorough theoretical research. A extra lifelike kind of price generation is studied the place worth functionality approximations are assumed to have finite error. Adaptive Dynamic Programming additionally information one other road of the ADP process: coverage generation. either uncomplicated and generalized kinds of policy-iteration-based ADP are studied with entire and thorough theoretical research by way of convergence, optimality, balance, and blunder bounds. between continuous-time platforms, the keep watch over of affine and nonaffine nonlinear platforms is studied utilizing the ADP method that is then prolonged to different branches of regulate thought together with decentralized keep watch over, powerful and assured price keep an eye on, and online game concept. within the final a part of the ebook the real-world importance of ADP conception is gifted, concentrating on 3 program examples built from the authors’ work:

• renewable power scheduling for clever energy grids;• coal gasification approaches; and• water–gas shift reactions.
Researchers learning clever keep an eye on tools and practitioners seeking to follow them within the chemical-process and power-supply industries will locate a lot to curiosity them during this thorough remedy of a complicated method of control.

Show description

Read or Download Adaptive Dynamic Programming with Applications in Optimal Control PDF

Similar robotics & automation books

Download e-book for iPad: Modelling and Parameter Estimation of Dynamic Systems (IEE by J. R. Raol, G. Girija, J. Singh

Parameter estimation is the method of utilizing observations from a process to improve mathematical types that accurately signify the procedure dynamics. The assumed version comprises a finite set of parameters, the values of that are calculated utilizing estimation ideas. lots of the concepts that exist are in response to least-square minimization of mistakes among the version reaction and real process reaction.

Read e-book online Adaptive control PDF

Compatible for complex undergraduates and graduate scholars, this evaluation introduces theoretical and functional facets of adaptive keep watch over. It offers an outstanding point of view on ideas and an lively wisdom of key ways, providing a well-developed feel of whilst to take advantage of adaptive strategies and whilst different tools are extra applicable.

Download e-book for kindle: Stability and Control of Time-delay Systems by Luc Dugard, Erik I. Verriest

Even though the decade has witnessed major advances on top of things concept for finite and limitless dimensional platforms, the steadiness and keep an eye on of time-delay platforms haven't been totally investigated. Many difficulties exist during this box which are nonetheless unresolved, and there's a tendency for the numerical equipment on hand both to be too basic or too particular to be utilized appropriately throughout quite a number difficulties.

Download e-book for kindle: Robotics: Science and Systems V by Jeff Trinkle, Yoky Matsuoka, Jose A. Castellanos

Robotics: technological know-how and structures V spans a large spectrum of robotics, bringing jointly researchers engaged on the principles of robotics, robotics purposes, and the research of robotics platforms. This quantity offers the lawsuits of the 5th annual Robotics: technology and structures convention, held in 2009 on the collage of Washington in Seattle.

Extra resources for Adaptive Dynamic Programming with Applications in Optimal Control

Sample text

Vi+1 (x) = − R−1 (x)gT (x) 2 dx The following results were shown in [72, 73]. 3 Adaptive Dynamic Programming 21 (1) The sequence of functions {Vi } obtained above converges to the optimal cost function J ∗ . 23), for all i = 0, 1, . . (3) Each of the value functions Vi+1 (x) is a Lyapunov function of the plant, for all i = 0, 1, . . 23) with the following value function ∞ V (x(t)) = ∞ U(x(τ ), u(τ ))dτ = t x T(τ )Qx(τ ) + uT(τ )Rx(τ ) dτ, t where Q and R are positive-definite matrices. The successive approximation to the HJB equation starts with an initial stabilizing control law v0 (x).

22), one will get a sequence of functions Vi . This sequence {Vi } will converge to the bound V (or V ) of the cost function J ∗ . Consequently, ui will approximate the optimal control when i tends to ∞. It is important to note that the sequences {Vi } and {ui } are obtainable by computation and they approximate the optimal cost and the optimal control law, respectively. Some further theoretical results for ADP have been obtained in [72, 73]. These works investigated the stability and optimality for some special cases of ADP.

25) repeatedly, one will get sequences of estimations of the optimal cost function J ∗ and the optimal control u∗ . Starting from an initial stabilizing control v0 (x), for i = 0, 1, . . , the approximation is given by the following iterations between value functions ∞ Vi+1 (x) = U(x(τ ), vi (τ ))dτ t and control laws dVi+1 (x) 1 . vi+1 (x) = − R−1 (x)gT (x) 2 dx The following results were shown in [72, 73]. 3 Adaptive Dynamic Programming 21 (1) The sequence of functions {Vi } obtained above converges to the optimal cost function J ∗ .

Download PDF sample

Adaptive Dynamic Programming with Applications in Optimal Control by Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li


by Richard
4.3

Rated 4.13 of 5 – based on 50 votes