Retrieval of Multimedia Content on the Web

Lecturer:

Tomáš Skopal (gar.)

Tutor:

David Hoksza, Tomáš Skopal (gar.), Jiří Novák

Supervisor:

Department of Software Engineering

Synopsis:

The student obtains general knowledge regarding interfaces of portals providing multimedia content, the principles of similarity search, the methods of feature extraction from multimedia objects, indexing, and structure of distributed search engines.

Requirements:

Basic knowledge of database systems, data structures, programming, internet technologies, calculus.

Syllabus of lectures:

1. Web platforms for retrieval and sharing of multimedia content.

2. Web interfaces, modalities and quality of retrieval.

3. Text-based and bag-of-words models.

4. Similarity search model - models and queries.

5. Similarity search model - popular similarity functions.

6. Image features - MPEG7 features.

7. Robust local features in images and 2D shapes.

8. Video retrieval techniques.

9. Feature extraction from audio, music and melody.

10. Principles of metric indexing.

11. Metric access methods.

12. Unified model of similarity search in (non)metric spaces.

13. Distributed image search engines on the web.

Syllabus of tutorials:

1. Project topic presentation.

2. Group consultations.

3. Group consultations.

4. Individual consultations.

5. Individual consultations.

6. Project presentation.

7. Project presentation.

Study Objective:

The module introduces the technologies of retrieval of multimedia content on the web. Since multimedia applications and databases acquire even larger space on the web, the module offers a perspective to the future developers of multimedia applications and databases - in and out of the web environment.

Study materials:

1. Zezula, P, Amato, G., Dohnal, V., Batko, M. „Similarity Search: The Metric Space Approach“. Springer, 2005. ISBN 0387291466.

2. Nicolas Hervé, Nozha Boujemaa: „Image annotation: which approach for realistic databases?“, ACM International Conference on Image and Video Retrieval, 2007.

3. Castelli, V., Bergman, L. D. „Image Databases: Search and Retrieval of Digital Imagery“. Wiley-Interscience, 2001. ISBN 0471321168.

4. Ritendra Datta, Dhiraj Joshi, Jia Li, James Z. Wang, „Image Retrieval: Ideas, Influences, and Trends of the New Age“, ACM Computing Surveys 40: 1, 2008

5. Berry, M. W., Browne, M. „Understanding Search Engines: Mathematical Modeling and Text Retrieval (2nd Edition)“. Society for Industrial and Applied Mathematics, 2005. ISBN 0898715814.

Note:

Time-table for winter semester 2011/2012:

	06:00–08:0008:00–10:0010:00–12:0012:00–14:0014:00–16:0016:00–18:0018:00–20:0020:00–22:0022:00–24:00
Mon	roomT9:107 Skopal T. 11:00–12:30 (lecture parallel1) Dejvice Posluchárna
Tue	roomT9:351 Novák J. 07:30–09:00 EVEN WEEK (lecture parallel1 parallel nr.104) Dejvice NBFIT PC ucebnaroomT9:351 Novák J. 09:15–10:45 ODD WEEK (lecture parallel1 parallel nr.101) Dejvice NBFIT PC ucebnaroomT9:351 Novák J. 11:00–12:30 EVEN WEEK (lecture parallel1 parallel nr.102) Dejvice NBFIT PC ucebna roomT9:351 Novák J. 07:30–09:00 ODD WEEK (lecture parallel1 parallel nr.105) Dejvice NBFIT PC ucebnaroomT9:351 Novák J. 11:00–12:30 ODD WEEK (lecture parallel1 parallel nr.103) Dejvice NBFIT PC ucebna
Fri
Thu
Fri

Time-table for summer semester 2011/2012:

Time-table is not available yet

The course is a part of the following study plans:

• Master Branch Web Engineering - Version for Students who Enrolled in 2010, Presented in Czech (compulsory course of the branch)
• Web and Software Engineering, Presented in Czech, Version for Students who Enrolled in 2011 (compulsory course of the branch)
• Web and Software Engineering, Presented in Czech, Version for Students who Enrolled in 2012 (compulsory course of the branch)