Recognition and Machine Learning

Relations:

It is not possible to register for the course B4B33RPZ if the student is concurrently registered for or has already completed the course BE5B33RPZ (mutually exclusive courses).

It is not possible to register for the course B4B33RPZ if the student is concurrently registered for or has already completed the course AE4B33RPZ (mutually exclusive courses).

In order to register for the course B4B33RPZ, the student must have registered for the required number of courses in the group BEZBM no later than in the same semester.

The requirement for course B4B33RPZ can be fulfilled by substitution with the course BE5B33RPZ.

It is not possible to register for the course B4B33RPZ if the student is concurrently registered for or has previously completed the course BE5B33RPZ (mutually exclusive courses).

Course guarantor:

Jiří Matas

Lecturer:

Ondřej Drbohlav, Jiří Matas

Tutor:

Klára Janoušková, Jiří Matas, Michal Neoral, Jonáš Šerých, Jan Šochman, Tomáš Vojíř, Andrii Yermakov

Supervisor:

Department of Cybernetics

Synopsis:

The basic formulations of the statistical decision problem are presented. The necessary knowledge about the (statistical) relationship between observations and classes of objects is acquired by learning on the raining set. The course covers both well-established and advanced classifier learning methods, as Perceptron, AdaBoost, Support Vector Machines, and Neural Nets.

This course is also part of the inter-university programme prg.ai Minor. It pools the best of AI education in Prague to provide students with a deeper and broader insight into the field of artificial intelligence. More information is available at https://prg.ai/minor.

Requirements:

Knowledge of linear algebra, mathematical analysis and probability and statistics.

Syllabus of lectures:

1.The pattern recognition problem. Overview of the Course. Basic notions.

2.The Bayesian decision-making problem, i.e. minimization of expected loss.

3.Non-bayesian decision problems.

4.Parameter estimation. The maximum likelihood method.

5.The nearest neighbour classifier.

6.Linear classifiers. Perceptron learning.

7.The Adaboost method.

8.Learning as a quadratic optimization problem. SVM classifiers.

9.Feed-forward neural nets. The backpropagation algorithm.

10.Decision trees.

11.Logistic regression.

12.The EM (Expectation Maximization) algorithm.

13.Sequential decision-making (Wald´s sequential test).

14.Recap.

Syllabus of tutorials:

Students follow the lecture topics and implement most of the discussed algorithms in Python.

1. Introduction, work with Python, simple example

2. Bayesian decision task

3. Non-bayesian tasks - the minimax task

4. Non-parametrical estimates - parzen windows

5. MLE, MAP and Bayes parameter estimation

6. Logistic regression

7. Problem solving / exam questions

8. Linear classifier - perceptron

9. Support Vector Machine

10. AdaBoost

11. K-means clustering

12. Convolutional neural networks

13. Problem solving / exam questions

Study Objective:

To teach the student to formalize statistical decision making problems, to use machine learning techniques and to solve pattern recognition problems with the most popular classifiers (SVM, AdaBoost, neural net, nearest neighbour).

Study materials:

1. Duda, Hart, Stork: Pattern Classification, John Willey and Sons, 2nd edition, New York,2001.

2. Schlesinger, Hlavac: Ten Lectures on Statistical and Structural Pattern Recognition, 2002.

Note:

Further information:

https://cw.fel.cvut.cz/wiki/courses/B4B33RPZ

Time-table for winter semester 2025/2026:

	06:00–08:0008:00–10:0010:00–12:0012:00–14:0014:00–16:0016:00–18:0018:00–20:0020:00–22:0022:00–24:00
Mon
Tue
Wed
Thu
Fri	roomKN:E-301 Matas J. Drbohlav O. 11:00–12:30 (lecture parallel1) Karlovo nám. roomKN:E-132 Vojíř T. 12:45–14:15 (lecture parallel1 parallel nr.101) Karlovo nám. roomKN:E-132 Neoral M. 14:30–16:00 (lecture parallel1 parallel nr.103) Karlovo nám. roomKN:E-230 Janoušková K. 12:45–14:15 (lecture parallel1 parallel nr.102) Karlovo nám. roomKN:E-230 Yermakov A. 14:30–16:00 (lecture parallel1 parallel nr.104) Karlovo nám. roomKN:E-112 Šerých J. 12:45–14:15 (lecture parallel1 parallel nr.105) Karlovo nám.

Time-table for summer semester 2025/2026:

Time-table is not available yet

The course is a part of the following study plans:

• Open Informatics - Computer Science 2016 (compulsory course of the specialization)
• Open Informatics (compulsory course of the specialization)
• Medical electronics and bioinformatics (compulsory course in the program)
• Open Informatics - Artificial Intelligence and Computer Science 2018 (compulsory course of the branch)
• prg.ai/minor-tech (elective course)
• Open Informatics - Artificial Intelligence and Computer Science 2025 (compulsory course of the branch)