Retrieval from Multimedia

Course guarantor:

Lecturer:

Tutor:

Supervisor:

Department of Software Engineering

Synopsis:

The student obtains general knowledge regarding interfaces of portals providing multimedia content, the principles of similarity search, the methods of feature extraction from multimedia objects, indexing, and structure of distributed search engines.

Requirements:

Basic knowledge of database systems, data structures, programming, internet technologies, calculus.

Syllabus of lectures:

1. Web platforms for retrieval and sharing of multimedia content

2. Web interfaces, means and quality of retrieval

3. Text-based and bag-of-features models

4. Similarity search models and queries

5. Similarity search popular similarity functions

6. Global image descriptors - analytic models

7. Global image descriptors - deep learning

8. Local image features

9. Retrieval of 2D and 3D models

10. Feature extraction from video, audio, music and melody

11. Principles of multimedia indexing

12. Metric access methods

13. Approximate similarity search

Syllabus of tutorials:

1. Project topic presentation.

2. Group consultations.

3. Group consultations.

4. Individual consultations.

5. Individual consultations.

6. Project presentation.

7. Project presentation.

Study Objective:

The module introduces the technologies of retrieval of multimedia content on the web. Since multimedia applications and databases acquire even larger space on the web, the module offers a perspective to the future developers of multimedia applications and databases - in and out of the web environment.

Study materials:

course slides +

1) Ricardo Baeza-Yates, Berthier Ribeiro-Neto. Modern Information Retrieval: The Concepts and Technology behind Search, 2011, Addison-Wesley Professional, ISBN-10: 0321416910

2) Phillipe Salembier, B. S. Manjunath, Philippe Salembier, Thomas Sikora. Introduction to MPEG 7: Multimedia Content Description Language, 2002, Wiley, ISBN-10: 0471486787

3) K. Selçuk Candan, Maria Luisa Sapino. Data Management for Multimedia Retrieval, 2010, Cambridge University Press, ISBN-10: 0521887399

4) Pavel Zezula, Giuseppe Amato, Vlastislav Dohnal, Michal Batko. Similarity Search: The Metric Space Approach, 2005, Springer, ISBN-10: 0387291466

Note:

This course is presented in Czech.

Further information:

https://moodle-vyuka.cvut.cz/course/view.php?id=7757

No time-table has been prepared for this course

The course is a part of the following study plans:

• Master specialization Computer Security, in Czech, 2020 (elective course)
• Master specialization Design and Programming of Embedded Systems, in Czech, 2020 (elective course)
• Master specialization Computer Systems and Networks, in Czech, 202 (elective course)
• Master specialization Management Informatics, in Czech, 2020 (elective course)
• Master specialization Software Engineering, in Czech, 2020 (elective course)
• Master specialization System Programming, in Czech, version from 2020 (elective course)
• Master specialization Web Engineering, in Czech, 2020 (PS)
• Master specialization Knowledge Engineering, in Czech, 2020 (elective course)
• Master specialization Computer Science, in Czech, 2020 (elective course)
• Mgr. programme, for the phase of study without specialisation, ver. for 2020 and higher (VO, elective course)
• Master Specialization Digital Business Engineering, 2023 (VO)
• Master specialization System Programming, in Czech, version from 2023 (elective course)
• Master specialization Computer Science, in Czech, 2023 (elective course)