Stochastic Games and Bayesian Decisions Making
Code  Completion  Credits  Range  Language 

01SBAR  ZK  3  2+1  Czech 
 Garant předmětu:
 Lecturer:
 Tutor:
 Supervisor:
 Department of Mathematics
 Synopsis:

The main goal of the subject is to provide decision making mathematical principles with random effects, optimal and robust strategies and their mutual links together with computational aspects for the real applications. The techniques are illustrated within practical examples originating from point and interval estimation and statistical hypothesis testing.
 Requirements:

Basic course of Calculus and Probability (in the extent of the courses 01MAA34 or 01MAB34, 01PRA1 nebo 01PRST held at the FNSPE CTU in Prague).
 Syllabus of lectures:

1. Sufficient statistics, general principles of classical statistics, conditionality, likelihood, sequential principles and their relations, Bayesian principle, Bayesian complete model and its advantages. 2. Loss and risk functions, utility function and its existence, decision functions, . convex loss functions, RaoBlackwell theorem, complete classes of optimal strategies, conditions. Bayes optimal decision strategy, prior and posterior Bayesian risk. Families of aprior informations, uncertainty principle, Jeffreys densities, conjugated systems, examples. 3. Minimax strategies, uniformly best strategy, minimum distance strategy, admissibility principle and its consequences within classical and Bayesian statistics.Stein effect. 4. Score functions and their robust properties, Shannon entropy, fdivergences, maximum entropy principle, new extended families of divergences and its metric and robust properties, minimum distance point estimators, min.Kolmogorov, Lévy and discrepancy decision functions and its L1 consistency and qualitative robustness, Kolmogorov entropy, VapnikChervonenkis dimension. 5. Numerical procedures, approximative calculations in higher dimensions, MonteCarlo approaches, importance sampling, convergence, Metropolis algorithm. Second order Laplace asymptotic expansion, fully exponential forms, regularity assumptions for stochastic expansion/approximation, the results of KassTierneyKadaneho.
 Syllabus of tutorials:

Principle calculations for the specific optimal strategies and their properties: 1. Sufficient statistics, likelihood methods, applications of the RaoBlackwell theorem, calculations of the best unbiased decision functions for Poisson distribution. 2. Bayesian principle within various loss functions, prior distribution selection, calculations for the uncertainty principle, Jeffreys densities and conjugated families of prior densities for known distributions. 3. Minimax strategy, JamesSteinovy shrinkage estimates. 4. Minimum distance decisions, fdivergence calculations for particular distributions, VapnikChervonenkis dimension illustrations. 5. Monte Carlo optimal decision in case of normal truncated model.
 Study Objective:

Knowledge: Extension of the decision makinng and game theory principles with random effects and their application in stochastic optimization tasks.
Abilities: Orientation in various stochastical approaches and their properties.
 Study materials:

[1] Berger J.O., Statistical Decision Theory and Bayesian Analysis, Springer, N.Y., 1985.
[2] Fishman G.S., Monte Carlo, Springer, 1996.
[3] Bernardo J.M., Smith A.F.M., Bayesian Theory, Wiley, 1994.
[4] Maitra A.P., Sudderth W.D., Discrete Gambling and Sochastic Games, Springer, 1996.
 Note:
 Further information:
 No timetable has been prepared for this course
 The course is a part of the following study plans: