WP4 (en)

WP4: Numerical Simulation methods for Markov models

Objectives

Develop new solution techniques for: Markov Chains (stochastic bounds, truncation...), Semi-Markov Additive Processes (transients, hitting times...), Markov Decision Processes (MDPs) and Markov Games (structural approaches).

Structure

• Responsible: A. Jean-Marie
• Participants: A. Bušić, J.-M. Fourneau, D. T. Thu Ha, N. Pekergin, M.-A. Tran, E. Hyon, F. Delbot