Logo ČVUT
CZECH TECHNICAL UNIVERSITY IN PRAGUE
STUDY PLANS
2023/2024

GPU Architectures and Programming

Login to KOS for course enrollment Display time-table
Code Completion Credits Range Language
NI-GPU Z,ZK 5 2P+1C Czech
Garant předmětu:
Ivan Šimeček
Lecturer:
Ivan Šimeček
Tutor:
Ivan Šimeček
Supervisor:
Department of Computer Systems
Synopsis:

Students will gain knowledge of the internal architecture of modern massively parallel GPU processors. They will learn to program them mainly in the CUDA programming environment, which is already a widespread programming technology of GPU processors. As an integral part of the effective computational use of these hierarchical computational structures, students will also learn optimization programming techniques and methods of programming multiprocessor GPU systems.

Requirements:

Basics of programming in C and C ++ (at the level of subjects BI-PA1 and BI-PA2), it is recommended to complete the subject Parallel and Distributed Programming (MI-PDP).

Syllabus of lectures:

1. GPU microarchitecture.

2.-4. (3) CUDA programming language.

5. Basic parallel operations (reduction and prefix sum).

6. Methods of synchronization of fibers and fiber blocks.

7. Optimization I: general optimization of massively parallel codes

8. Optimization II: SIMT architecture, combined memory access.

9. Optimization III: Memory subsystem architecture.

10. Collaboration multiple GPUs.

11. Asynchronous GPU calculations.

12. Case studies of GPU programs, development, debugging of GPU applications

13. HPC libraries and other APIs for GPGPU.

Syllabus of tutorials:

1) Introduction to the environment, assignment of term papers

2) Submission of sequential implementation

3) Compilation of GPU code, involvement of libraries

4) Working with code debugging tools and profiling tools

5) consultation on GPU implementation

6) submission of GPU implementation, credit

Study Objective:
Study materials:

Brian Tuomanen „Hands-On GPU Programming with Python and CUDA: Explore high-performance parallel computing with CUDA“ , Packt Publishing, 2018

Sudhakar Yalamanchili „GPU Architectures“ https://ece8823-sy.ece.gatech.edu/

J. Sanders, E. Kandrot ''CUDA by Example: An Introduction to General-Purpose GPU Programming''

David B. Kirk, Wen-mei W. Hwu: Programming Massively Parallel Processors: A Hands-on Approach. 1st ed., Morgan Kaufmann, 2010.

Note:
Further information:
https://courses.fit.cvut.cz/NI-GPU/
Time-table for winter semester 2023/2024:
Time-table is not available yet
Time-table for summer semester 2023/2024:
06:00–08:0008:00–10:0010:00–12:0012:00–14:0014:00–16:0016:00–18:0018:00–20:0020:00–22:0022:00–24:00
Mon
Tue
Wed
roomT9:347
Šimeček I.
11:00–12:30
(lecture parallel1)
Dejvice
NBFIT učebna
roomT9:350
Šimeček I.
14:30–16:00
EVEN WEEK

(lecture parallel1
parallel nr.101)

Dejvice
NBFIT PC ucebna
Thu
Fri
The course is a part of the following study plans:
Data valid to 2024-06-20
Aktualizace výše uvedených informací naleznete na adrese https://bilakniha.cvut.cz/en/predmet6072006.html