Pattern Recognition and Machine Learning
Code  Completion  Credits  Range  Language 

AE4B33RPZ  Z,ZK  6  2P+2C 
 The course cannot be taken simultaneously with:
 Pattern Recognition and Machine Learning (A4B33RPZ)
 The course is a substitute for:
 Pattern Recognition and Machine Learning (A4B33RPZ)
 Lecturer:
 Tutor:
 Supervisor:
 Department of Cybernetics
 Synopsis:

The basic formulations of the statistical decision problem are presented. The necessary knowledge about the (statistical) relationship between observations and classes of objects is acquired by learning on the raining set. The course covers both wellestablished and advanced classifier learning methods, as Perceptron, AdaBoost, Support Vector Machines, and Neural Nets.
 Requirements:

Knowledge of linear algebra, mathematical analysis and
probability and statistics.
 Syllabus of lectures:

1.The pattern recognition problem. Overview of the Course. Basic notions.
2.The Bayesian decisionmaking problem, i.e. minimization of expected loss.
3.Nonbayesian decision problems.
4.Parameter estimation. The maximum likelihood method.
5.The nearest neighbour classifier.
6.Linear classifiers. Perceptron learning.
7.The Adaboost method.
8.Learning as a quadratic optimization problem. SVM classifiers.
9.Feedforward neural nets. The backpropagation algorithm.
10.Decision trees.
11.Logistic regression.
12.The EM (Expectation Maximization) algorithm.
13.Sequential decisionmaking (Wald´s sequential test).
14.Recap.
 Syllabus of tutorials:

Students solve four or five pattern recognition problems, for instance a simplified version of OCR (optical character recognition), face detection or spam detection using either classical methods or trained classifiers.
1.Introduction to MATLAB and the STPR toolbox, a simple recognition experiment
2.The Bayes recognition problem
3.Nonbayesian problems I: the NeymanPearson problem.
4.Nonbayesian problems II: The minimax problem.
5.Maximum likelihood estimates.
6.Nonparametric estimates, Parzen windows.
7.Linear classifiers, the perceptron algorithm
8.Adaboost
9.Support Vector Machines I
10.Support Vector Machines II
11.EM algoritmus I
12.EM algoritmus II
13.Submission of reports. Discussion of results.
14.Submission of reports. Discussion of results.
 Study Objective:

To teach the student to formalize statistical decision making problems, to use machine learning techniques and to solve pattern recognition problems with the most popular classifiers (SVM, AdaBoost, neural net, nearest neighbour).
 Study materials:

1.Duda, Hart, Stork: Pattern Classification, 2001.
2.Bishop: Pattern Recognition and Machine Learning, 2006.
3.Schlesinger, Hlavac: Ten Lectures on Statistical and Structural Pattern Recognition, 2002.
 Note:
 Further information:
 https://cw.fel.cvut.cz/wiki/courses/ae4b33rpz/start
 No timetable has been prepared for this course
 The course is a part of the following study plans:

 Otevřená informatika  Počítačové systémy (compulsory course in the program)
 Otevřená informatika  Informatika a počítačové vědy (compulsory course in the program)
 Otevřená informatika  Softwarové systémy (compulsory course in the program)
 Cybernetics and Robotics  Robotics (elective course)
 Cybernetics and Robotics  Senzors and Instrumention (elective course)
 Cybernetics and Robotics  Systems and Control (elective course)
 Electrical Engineering, Power Engineering and Management  Applied Electrical Engineering (elective course)
 Electrical Engineering, Power Engineering and Management  Electrical Engineering and Management (elective course)
 Communications, Multimedia and Electronics  Communication Technology (elective course)
 Communications, Multimedia and Electronics  Multimedia Technology (elective course)
 Communications, Multimedia and Electronics  Applied Electronics (elective course)
 Communications, Multimedia and Electronics  Network and Information Technology (elective course)
 Open Informatics  Computer and Information Science (compulsory course of the specialization)
 Otevřená informatika  před rozřazením do oborů (compulsory course in the program)
 Electrical Engineering, Power Engineering and Management (elective course)
 Communications, Multimedia and Electronics (elective course)
 Cybernetics and Robotics (elective course)
 Communications, Multimedia and Electronics  Communications and Electronics (elective course)