A dynamic programming approach to finite-horizon coherent quantum LQG control

The paper considers the coherent quantum Linear Quadratic Gaussian (CQLQG) control problem for time-varying quantum plants governed by linear quantum stochastic differential equations over a bounded time interval. A controller is sought among quantum linear systems satisfying physical realizability (PR) conditions. The latter describe the dynamic equivalence of the system to an open quantum harmonic oscillator and relate its state-space matrices to the free Hamiltonian, coupling and scattering operators of the oscillator. Using the Hamiltonian parameterization of PR controllers, the CQLQG problem is recast into an optimal control problem for a deterministic system governed by a differential Lyapunov equation. The state of this subsidiary system is the symmetric part of the quantum covariance matrix of the plant-controller state vector. The resulting covariance control problem is treated using dynamic programming and Pontryagin's minimum principle. The associated Hamilton-Jacobi-Bellman equation for the minimum cost function involves Frechet differentiation with respect to matrix-valued variables. The gain matrices of the CQLQG optimal controller are shown to satisfy a quasi-separation property as a weaker quantum counterpart of the filtering/control decomposition of classical LQG controllers.