Logo ČVUT
CZECH TECHNICAL UNIVERSITY IN PRAGUE
STUDY PLANS
2023/2024
UPOZORNĚNÍ: Jsou dostupné studijní plány pro následující akademický rok.

Bayesian Methods for Machine Learning

Login to KOS for course enrollment Display time-table
Code Completion Credits Range Language
NI-BML KZ 5 2P+1C Czech
Garant předmětu:
Kamil Dedecius
Lecturer:
Kamil Dedecius, Ondřej Tichý
Tutor:
Kamil Dedecius, Ondřej Tichý
Supervisor:
Department of Applied Mathematics
Synopsis:

The subject is focused on practical use of basic Bayesian modeling methods in the dynamically evolving machine learning theory. In particular, it studies the construction of appropriate models providing description of real phenomena, as well as their subsequent use, e.g., for forecasting of future evolution or learning about the hidden variables (true object position from noisy observations etc.). The emphasis is put on understanding of explained principles and methods and their practical adoption. For this purpose, a number of real world examples and applications will be presented to students, for instance, 2D/3D object tracking, radiation source term estimation, or separation in medical imaging. The students will try to solve some of them.

Requirements:

Basic knowledge of probability theory and linear algebra.

Syllabus of lectures:

1. Basics and details of the Bayesian theory - uncertainty, knowledge evolution, types of estimates, methods.

2. Linear models in machine learning, online modeling, prediction, examples.

3. Generalized linear models GLM, approximation and sequential (online) estimation.

4. Linear model, structure estimation, prior-based regularization.

5. Bilinear models and Bayesian approach to PCA, estimation of the number of components.

6. Application of generalized linear models in real machine learning problems.

7. Basic state-space models, Kalman filter.

8. Introduction into Monte Carlo methods, rejection sampling.

9. Sequential Monte Carlo estimation of state-space models, bootstrap particle filter, resampling.

10. Hierarchical learning and its applications.

11. Graphical models, naive Bayes.

12. Introduction to deep learning and probabilistic graphical models.

Syllabus of tutorials:

1. Introduction, construction of a linear model and its estimation, knowledge evolution, forecasting.

2. Bayesian sequential linear regression, regularization, demonstrations on real data.

3. Sequential logistic regression with real data.

4. Bayesian matrix decomposition problem and its application, e.g., in biomedicine.

5. Construction of a state-space model for a real world problem and its estimation.

6. Particle filtration in practical problems of machine learning.

Study Objective:

The aim of the subject is to introduce the students to the wide application field of the Bayesian theory in machine learning.

Study materials:

1. Andrew Gelman et al., Bayesian Data Analysis, Chapman and Hall (2013), ISBN 1439840954.

2. David Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press (2012), ISBN 978-0-521-51814-7.

Note:
Further information:
https://courses.fit.cvut.cz/NI-BML/
Time-table for winter semester 2023/2024:
Time-table is not available yet
Time-table for summer semester 2023/2024:
06:00–08:0008:00–10:0010:00–12:0012:00–14:0014:00–16:0016:00–18:0018:00–20:0020:00–22:0022:00–24:00
Mon
Tue
roomT9:349
Dedecius K.
Tichý O.

11:00–12:30
(lecture parallel1)
Dejvice
NBFIT PC učebna
roomT9:351
Dedecius K.
Tichý O.

12:45–13:30
(lecture parallel1
parallel nr.101)

Dejvice
NBFIT PC ucebna
roomT9:351
Dedecius K.
Tichý O.

13:30–14:15
(lecture parallel1
parallel nr.102)

Dejvice
NBFIT PC ucebna
Wed
Thu
Fri
The course is a part of the following study plans:
Data valid to 2024-03-27
Aktualizace výše uvedených informací naleznete na adrese https://bilakniha.cvut.cz/en/predmet6105606.html