2506.15542

Total: 1

#1 Long run control of nonhomogeneous Markov processes [PDF] [Copy] [Kimi] [REL]

Author: Łukasz Stettner

In the paper average reward per unit time and average risk sensitive reward functionals are considered for controlled nonhomogeneous Markov processes. Existence of solutions to suitable Bellman equations is shown. Continuity of the value functions with respect to risk parameter is also proved. Finally stability of functionals with respect to pointwise convergence of Markov controls is studied.

Subjects: Optimization and Control , Probability

Publish: 2025-06-18 15:16:11 UTC