Nonlinear Continuous Optimization and Numerical Methods
- Jaroslav Kruis (guarantor)
- Jaroslav Kruis (guarantor)
- Department of Theoretical Computer Science
Students will be introduced to nonlinear continuous optimization, principles of the most popular methods of optimization and applications of such methods to real-world problems. They will also learn the finite element method and the finite difference method used for solving ordinary and partial differential equations in engineering. They will learn to solve systems of linear algebraic equations that arise from discretization of the continuous problems by direct and iterative algorithms. They will also learn to implement these algorithms sequentially as well as in parallel.
Basic knowledge of linear algebra (vectors, matrices, systems of linear algebraic equations, Gaussian elimination method), polynoms, differential calculus (derivative, integral).
- Syllabus of lectures:
1. Partial derivative, gradient, hessian.
2. Continuous optimization of the 1st and 2nd order.
3. Quasi-Newton method, conjugate gradient method.
4. Application of methods of nonlinear continuous optimization.
5. Introduction to ordinary and partial differential equations (taxonomy, the notion of the solution, physical interpretation).
6. Ordinary differential equations - boundary value problem (exact solution, finite difference method, finite differences).
7. Ordinary differential equations - boundary value problem (finite element method).
8. Partial differential equations - stationary cases (finite difference method).
9. Partial differential equations - stationary cases (finite element method).
10. Ordinary differential equations - initial value problem.
11. Partial differential equations - nonstationary problems.
12. Iterative methods (Gauss-Seidel method, conjugate gradient method).
13. Introduction to domain decomposition methods. Parallel solvers of sets of linear equations.
- Syllabus of tutorials:
1.  Algorithms of continuous optimization.
2.  Numerical methods for solution of differential equations.
- Study Objective:
The module gives an introduction to continuous optimization with respect to the solution of complicated problems, e.g., data approximation or identification of model parameters. The second part deals with several parts of computational sciences, with the emphasis on the finite element method and the finite difference method which are massively used in all engineering branches, not only in academic community but also in industry.
- Study materials:
1. Kruis, J. ''Domain Decomposition Methods for Distributed Computing''. Saxe-Coburg Publications, 2007. ISBN 1874672237.
2. Petzold, L. R. ''Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations''. Society for Industrial and Applied Mathematics, 1998. ISBN 0898714125.
- Further information:
- Time-table for winter semester 2020/2021:
Mon Tue FriroomT9:302
- Time-table for summer semester 2020/2021:
- Time-table is not available yet
- The course is a part of the following study plans:
- Master specialization Computer Security, in Czech, 2020 (VO)
- Master specialization Design and Programming of Embedded Systems, in Czech, 2020 (VO)
- Master specialization Computer Systems and Networks, in Czech, 202 (VO)
- Master specialization Management Informatics, in Czech, 2020 (VO)
- Master specialization Software Engineering, in Czech, 2020 (VO)
- Master specialization System Programming, in Czech, 2020 (VO)
- Master specialization Web Engineering, in Czech, 2020 (VO)
- Master specialization Knowledge Engineering, in Czech, 2020 (VO)
- Master specialization Computer Science, in Czech, 2020 (PS)
- Master program, unspecified branch, in Czech, 2020 (VO)