Multimedia systems

Lectures:
Introduction to multimedia, overview of the field and challenges
Manipulation of image data
Video standards and manipulation of video data
Text-based information retrieval
Architecture of multimedia information retrieval
Evaluation of multimedia systems for information retrieval
Automatic image content description
Segmentation of image content
Segmentation of video content
Interactive media and augmented reality in multimedia systems
Lossless compression standards in multimedia
Lossy compression standards in multimedia
Exercises:
Exercises will take a form of project-oriented exercises in properly equipped student laboratories. Students will implement various algorithms, that will be covered in lectures, and test them on different datasets using a variety of sensor systems. Exercises will support an in-depth understanding of the theory. They will also encourage independent thinking and creativity.

Obvezna:
A. Del Bimbo: Visual Information Retrieval, Morgan Kaufmann 1999, ISBN 1-55860-624-6.
C. D. Manning, P. Raghavan, H. Schütze, Introduction to Information Retrieval, Cambridge University Press. 2008
Dopolnilna:
Mark S. Li Ze-Nian and Drew, Fundamentals of Multimedia, Prentice-Hall of India (2005)
Članki iz revij, kot npr. IEEE Multimedia. (dostopno na spletu)

Multimedia systems are an indispensable part of modern information technology. In the framework of this course, the students will acquire knowledge and skills needed for use, design and development of multimedia systems. The course will also deal with the problems related to efficient representations and processing multimedia data, such as text, graphics, animations, images, and video.
In addition, the students will obtain the following competences:
The ability to understand and solve professional challenges in computer and information science.
The ability of professional communication in the native language as well as a foreign language.
The ability to independently perform both less demanding and complex engineering and organisational tasks in certain narrow areas and independently solve specific well-defined tasks in computer and information science.

Knowledge and understanding:
Understanding of computer technology and computational methodology for use and development of components for multimedia systems.
Application:
Use of computer technology and computational methodology for specific applications of multimedia systems.
Reflection:
Understanding how the theory can be tuned for different application scenarios in the area of multimedia systems.
Transferable skills:
Solving other conceptually similar problems (e.g., other modalities) based on the models of multimedia systems.

Lectures, laboratory exercises in computer classroom with active participation. Individual work on excercises. Theory from the lectures made concrete with hands-on laboratory exercises. Special emphasis will be put on continuous assessment at exercises.

Final (written and oral exam)
grading: 5 (fail), 6-10 (pass) (according to the Statute of UL)

KRISTAN, Matej, LEONARDIS, Aleš. Online discriminative kernel density estimator with Gaussian kernels. IEEE transactions on cybernetics, ISSN 2168-2267. [Print ed.], 2014, vol. 44, no. 3, str. 355-365. , doi: . [COBISS-SI-ID 9907284]
ČEHOVIN, Luka, KRISTAN, Matej, LEONARDIS, Aleš. Robust visual tracking using an adaptive coupled-layer visual model. IEEE transactions on pattern analysis and machine intelligence, ISSN 0162-8828. [Print ed.], Apr. 2012, vol. 35, no. 4, str. 941-953, ilustr. [COBISS-SI-ID 9431124]
KRISTAN, Matej, LEONARDIS, Aleš, SKOČAJ, Danijel. Multivariate online kernel density estimation with Gaussian kernels. Pattern recognition, ISSN 0031-3203. [Print ed.], 2011, vol. 44, no. 10/11, str. 2630-2642, ilustr. [COBISS-SI-ID 8289876]
KRISTAN, Matej, SKOČAJ, Danijel, LEONARDIS, Aleš. Online kernel density estimation for interactive learning. Image and vision computing, ISSN 0262-8856. [Print ed.], Jul. 2010, vol. 28, no. 7, str. 1106-1116, ilustr. [COBISS-SI-ID 7326804]
KRISTAN, Matej, KOVAČIČ, Stanislav, LEONARDIS, Aleš, PERŠ, Janez. A two-stage dynamic model for visual tracking. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics, ISSN 1083-4419. [Print ed.], Dec. 2010, vol. 40, no. 6, str. 1505-1520, ilustr. [COBISS-SI-ID 7709524]