Retrieval of Multimedia Content on the Web

Lecturer:

Tomáš Skopal (gar.)

Tutor:

David Hoksza, Tomáš Skopal (gar.)

Supervisor:

Department of Software Engineering

Synopsis:

The student obtains general knowledge regarding interfaces of portals providing multimedia content, the principles of similarity search, the methods of feature extraction from multimedia objects, indexing, and structure of distributed search engines.

Requirements:

Basic knowledge of database systems, data structures, programming, internet technologies, calculus.

Syllabus of lectures:

1. Web platforms for retrieval and sharing of multimedia content.

2. Web interfaces, modalities, and the quality of retrieval.

3. Text-based and bag-of-words models.

4. Similarity search model - models and queries.

5. Similarity search model - popular similarity functions.

6. Image feature extraction - global features.

7. Image feature extraction - local features.

8. Feature extraction - video and geometries.

9. Feature extraction - audio.

10. Metric indexing - motivation and principles.

11. Metric indexing - data structures and algorithms.

12. Unified model of retrieval in (non)metric spaces.

13. Distributed image search engine on the web.

Syllabus of tutorials:

1. Project topic presentation.

2. Group consultations.

3. Group consultations.

4. Individual consultations.

5. Individual consultations.

6. Project presentation.

7. Project presentation.

Study Objective:

The module introduces the technologies of retrieval of multimedia content on the web. Since multimedia applications and databases acquire even larger space on the web, the module offers a perspective to the future developers of multimedia applications and databases - in and out of the web environment.

Study materials:

1. Zezula, P, Amato, G., Dohnal, V., Batko, M. „Similarity Search: The Metric Space Approach“. Springer, 2005. ISBN 0387291466.

2. Nicolas Hervé, Nozha Boujemaa: „Image annotation: which approach for realistic databases?“, ACM International Conference on Image and Video Retrieval, 2007.

3. Castelli, V., Bergman, L. D. „Image Databases: Search and Retrieval of Digital Imagery“. Wiley-Interscience, 2001. ISBN 0471321168.

4. Ritendra Datta, Dhiraj Joshi, Jia Li, James Z. Wang, "Image Retrieval: Ideas, Influences, and Trends of the New Age!, ACM Computing Surveys 40: 1, 2008

5. Berry, M. W., Browne, M. „Understanding Search Engines: Mathematical Modeling and Text Retrieval (2nd Edition)“. Society for Industrial and Applied Mathematics, 2005. ISBN 0898715814.

Note:

Further information:

No time-table has been prepared for this course

The course is a part of the following study plans:

• Web Engineering, Presented in English, Version for Students, who Enrolled in 2010 and 2011 (compulsory course of the branch)
• Master Informatics, Presented in English - Version for Students who Enrolled in 2010 (VO)
• Master Informatics, Presented in English - Version for Students who Enrolled in 2011 (VO)
• Master Informatics, Presented in English - Version for Students who Enrolled in 2012 (VO)
• Web Engineering, Presented in English - Version for Students who Enrolled in 2012 (compulsory course of the branch)