TY - JOUR
T1 - State distributions and minimum relative entropy noise sequences in uncertain stochastic systems
T2 - The discrete-time case
AU - Vladimirov, Igor G.
AU - Petersen, Ian R.
N1 - Publisher Copyright:
© 2015 Society for Industrial and Applied Mathematics.
PY - 2015
Y1 - 2015
N2 - This paper is concerned with dissipativity theory and robust performance analysis and design of discrete-time stochastic systems driven by statistically uncertain random noise. The uncertainty is quantified by the conditional relative entropy of the actual probability law of the noise with respect to a nominal product measure corresponding to a white noise sequence. We discuss a balance equation, dissipation inequality, and superadditivity property for the corresponding conditional relative entropy supply as a function of time. The problem of minimizing the supply, required to drive the system between given state distributions over a specified time horizon, is considered. Such variational problems, involving entropy and probabilistic boundary conditions, are known in the literature as Schrödinger bridge problems. In application to control systems, the minimum required conditional relative entropy supply characterizes the robustness of the system with respect to a statistically uncertain random noise. We obtain a dynamic programming Bellman equation for the minimum required supply and establish a Markov property of the worst-case noise with respect to the state of the system. For multivariable linear systems with a Gaussian white noise sequence as the nominal noise model and Gaussian initial and terminal state distributions, the minimum required conditional relative entropy supply is obtained using an algebraic Riccati equation which admits a closed-form solution. We propose a computable robustness index for such systems subjected to statistically uncertain random noises whose relative entropy rate does not exceed a given threshold, and provide examples to illustrate this approach. We also consider a minimax problem of robust optimization of systems against the class of noises and demonstrate its solution for a robust filter design example.
AB - This paper is concerned with dissipativity theory and robust performance analysis and design of discrete-time stochastic systems driven by statistically uncertain random noise. The uncertainty is quantified by the conditional relative entropy of the actual probability law of the noise with respect to a nominal product measure corresponding to a white noise sequence. We discuss a balance equation, dissipation inequality, and superadditivity property for the corresponding conditional relative entropy supply as a function of time. The problem of minimizing the supply, required to drive the system between given state distributions over a specified time horizon, is considered. Such variational problems, involving entropy and probabilistic boundary conditions, are known in the literature as Schrödinger bridge problems. In application to control systems, the minimum required conditional relative entropy supply characterizes the robustness of the system with respect to a statistically uncertain random noise. We obtain a dynamic programming Bellman equation for the minimum required supply and establish a Markov property of the worst-case noise with respect to the state of the system. For multivariable linear systems with a Gaussian white noise sequence as the nominal noise model and Gaussian initial and terminal state distributions, the minimum required conditional relative entropy supply is obtained using an algebraic Riccati equation which admits a closed-form solution. We propose a computable robustness index for such systems subjected to statistically uncertain random noises whose relative entropy rate does not exceed a given threshold, and provide examples to illustrate this approach. We also consider a minimax problem of robust optimization of systems against the class of noises and demonstrate its solution for a robust filter design example.
KW - Conditional relative entropy
KW - Dissipation inequality
KW - Markov noise strategies
KW - Minimum required supply
KW - Robust control/filtering design
KW - Robust performance analysis
KW - System robustness index
KW - Uncertain stochastic systems
UR - http://www.scopus.com/inward/record.url?scp=84937888597&partnerID=8YFLogxK
U2 - 10.1137/090765614
DO - 10.1137/090765614
M3 - Article
SN - 0363-0129
VL - 53
SP - 1107
EP - 1153
JO - SIAM Journal on Control and Optimization
JF - SIAM Journal on Control and Optimization
IS - 3
ER -