Logo ČVUT
ČESKÉ VYSOKÉ UČENÍ TECHNICKÉ V PRAZE
STUDIJNÍ PLÁNY
2024/2025

Parallel and Distributed Programming

Předmět není vypsán Nerozvrhuje se
Kód Zakončení Kredity Rozsah Jazyk výuky
MIE-PDP.16 Z,ZK 5 2P+2C anglicky

Předmět MIE-PDP.16 může být splněn v zastoupení předmětem MIE-PAR.2

Garant předmětu:
Přednášející:
Cvičící:
Předmět zajišťuje:
katedra počítačových systémů
Anotace:

Due to the development of cloud, web, and communication technologies and due to the shift of the Moore law into multicore and manycore CPUs, parallel and distributed applications are becoming ubiquitous. Students get acquainted with architectures of parallel and distributed computing systems, their models, theory of interconnection networks, and languages and environments for parallel programming of shared and distributed memory computers. On selected problems, they will learn the techniques of design of efficient and scalable parallel algorithms and methods of performance evaluation of their implementations.

Požadavky:

Basic sequential algorithmics, programming, complexity theory, computer architecture, graph theory.

Osnova přednášek:

1. Introduction into parallel and distributed programming.

2. Introduction into OpenMP.

3. Parallel algorithms for the state space search.

4. Prpgramming and performance tuning in OpenMP.

5. Parallel sorting in OpenMP.

6. Introduction into MPI.

7. Interconnection networks of parallel computers I.

8. Interconnection networks of parallel computers II.

9. Collective communication operations.

10. Parallel reduction and parallel scan. Parallel I/O.

11. Parallel algorithms in OpenMP/MPI I.

12. Parallel algorithms in OpenMP/MPI II.

Osnova cvičení:

1. Design and implementation of a sequential algorithm in C/C++.

2. Design and implementation of a parallel algorithm using OpenMP task parallel constructs.

3. Design and implementation of a parallel algorithm using OpenMP data parallel constructs.

4. Design and implementation of a parallel algorithm using MPI on a cluster.

5. Analysis of parallel performance and scalability of the resulting program and writing a technical report.

Cíle studia:

Due to the development of cloud, web, and communication technologies and due to the shift of the Moore law into multicore and manycore CPUs, parallel and distributed applications are becoming ubiquitous. Students get acquainted with architectures of parallel and distributed computing systems, their models, theory of interconnection networks, and languages and environments for parallel programming of shared and distributed memory computers. On selected problems, they will learn the techniques of design of efficient and scalable parallel algorithms and methods of performance evaluation of their implementations.

Studijní materiály:

1. Mattson, T.G. - Sanders, B.A. - Massingill, B.L.: Patterns for Parallel Programming. Addison-Wesley Professional. 2004. 978-0321940780.

2. Kumar, V. - Grama, A. - Gupta, A. - Karpis, G.: Introduction to Parallel Computing: Design and Analysis of Parallel Algorithms. Benjamin-Cummings. 1994. 0805331700.

3. Miller, R. - Boxer, L.: Algorithms Sequential and Parallel: A Unified Approach. Pearson Education. 1999. 0130863734.

4. Wilkinson, B. - Allen, M.: Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers. Prentice Hall. 1998. 0136717101.

5. Jaja, J.: An Introduction to Parallel Algorithms. Addison-Wesley. 1992. 0201548569.

Poznámka:

Information about the course and courseware are available at https://courses.fit.cvut.cz/MIE-PDP/. // Prerequisites: Basic sequential algorithmics, programming, complexity theory, computer architecture and graph theory.#Opozdilcům: Student, kteremu chybí PPR, si zapíše PDP a získá z něj zápočet.#Do studia opakovaně zapsaným studentů: student se zkouškou z PPR má právou na uznání zápočtu z PDP.

Další informace:
https://courses.fit.cvut.cz/MIE-PDP/
Pro tento předmět se rozvrh nepřipravuje
Předmět je součástí následujících studijních plánů:
Platnost dat k 29. 3. 2024
Aktualizace výše uvedených informací naleznete na adrese https://bilakniha.cvut.cz/cs/predmet4661606.html