Three-dimensional Computer Vision

Login to KOS for course enrollment Display time-table
Code Completion Credits Range Language
B4M33TDV Z,ZK 6 2p+2c Czech
Safety in Electrical Engineering for a master´s degree (BEZM)
The course cannot be taken simultaneously with:
3D Computer Vision (AE4M33TDV)
Three-dimensional Computer Vision (BE4M33TDV)
Radim Šára (guarantor)
Radim Šára (guarantor), Martin Matoušek
Department of Cybernetics

This course introduces methods and algorithms for 3D geometric scene reconstruction from images. The student will understand these methods and their essence well enough to be able to build variants of simple systems for reconstruction of 3D objects from a set of images or video, for inserting virtual objects to video-signal source, or for computing ego-motion trajectory from a sequence of images. The labs will be hands-on, the student will be gradually building a small functional 3D scene reconstruction system and using it to compute a virtual 3D model of an object of his/her choice.

Syllabus of lectures:

1. 3D computer vision, its goals and applications, course overview.

2. Geometry of points and lines in plane, ideal points and lines, point and line representations, line intersection and point join, homography.

3. Perspective camera model, center of projection, principal point, optical axis, optical ray and optical plane. Vanishing point and vanishing line, cross-ratio of four colinear points and its use for camera calibration. Radial distortion models.

4. Camera resection from six points, external camera orientation from three points.

5. Epipolar geometry, its representation by the fundamental matrix, essential matrix and its decomposition.

6. The seven-point algorithm for fundamental matrix estimation and the five-point algorithm for essential matrix estimation. Triangulation of points in 3D space from image correspondences.

7. The concept of algebraic and reprojection errors and Sampson approximation for reprojection error. Sampson error for fundamental matrix estimation.

8. Local optimization of Sampson error, derivation of a robust error by marginalization of a probabilistic model.

9. Robust optimization of geometric problems in 3D vision by MCMC methods.

10. Reconstruction of a multi-camera system, the bundle adjustment method, minimal and non-minimal representations for some basic geometric objects and mappings on them.

11. Introduction to stereoscopic vision, epipolar rectification of images.

12. The uniqueness, occlusion, ordering, coherence and continuity constraints in stereo and their representation in stereoscopic matching table.

13. Marroquin's greedy algorithm and the maximum-likelihood algorithm for stereoscopic matching.

14. Photometric stereo, its calibrated and uncalibrated versions.

Syllabus of tutorials:

1. Introduction, term project specification, instructions on how to select an object suitable for 3D reconstruction, on image capture, and on camera calibration.

2. An introductory computer programming exercise with points and lines in a plane.

3. An exercise on the geometric description of perspective camera. Robust maximum likelihood estimation of a planar line.

4. Computing sparse correspondences by WBS matcher.

5. A computer exercise with matching and estimation of two homographies in an image pair.

6. Calibration of poses of a set of cameras.

7. Midterm test.

8. Sparse point cloud reconstruction.

9. Optimization of point and camera estimates by bundle adjustment.

10. Epipolar rectification and dense stereomatching. Dense point cloud reconstruction.

11. 3D surface reconstruction.

12. Presentation and submission of resulting models.

Study Objective:

To master conceptual and practical knowledge of the basic methods in 3D computer vision.

Study materials:

R. Hartley and A. Zisserman. Multiple View Geometry. 2nd ed. Cambridge

University Press 2003.

Further information:
Time-table for winter semester 2018/2019:
Šára R.
(lecture parallel1)
Karlovo nám.
Trnkova posluchárna K5
Matoušek M.
(lecture parallel1
parallel nr.102)

Karlovo nám.
Laboratoř PC

(lecture parallel1
parallel nr.103)

Time-table for summer semester 2018/2019:
Time-table is not available yet
The course is a part of the following study plans:
Data valid to 2019-03-21
For updated information see http://bilakniha.cvut.cz/en/predmet4684606.html