Volume 10, Issue 2 (Journal of Control, V.10, N.2 Summer 2016)                   JoC 2016, 10(2): 35-43 | Back to browse issues page

XML Persian Abstract Print

Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Kafash B, Nikoeenezhad Z, Delavarkhalafi A. An iterative algorithm for solving stochastic optimal control via the Markov chain approximation. JoC 2016; 10 (2) :35-43
URL: http://joc.kntu.ac.ir/article-1-291-en.html
Abstract:   (9211 Views)

In this paper, a numerical method for solving stochastic optimal control problem by using Markov chain approximation method has presented. The basic idea of the Markov chain approximation method is to approximate the original controlled process by an appropriate controlled Markov chain on a finite state space. Also, we need to approximate the original cost function by one which is appropriate for the approximating chain. These approximations should be chosen such that a good numerical approximation to the associated optimal control problem can be obtained, which means the conditional mean and covariance of the changes in state of the chain are proportional to the local mean drift and covariance for the original process. The finite difference approximations are used to the construction of locally consistent approximating Markov chain, the coefficients of the resulting discrete equation can serve as the desired transition probabilities and interpolation interval. The convergence is analogous to the convergence of a sequence of finite difference or finite element approximations to an original problem as the approximation interval goes to zero. Finally, we propose an iterative algorithm for solving stochastic optimal control and efficiency of the proposed algorithm is illustrated by an example.

Full-Text [PDF 1541 kb]   (4662 Downloads)    
Type of Article: Research paper | Subject: Special
Received: 2015/09/20 | Accepted: 2016/12/14 | Published: 2016/12/14

Add your comments about this article : Your username or Email:

Send email to the article author

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

© 2024 CC BY-NC 4.0 | Journal of Control

Designed & Developed by : Yektaweb