Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 28 hours
Course Outline
Introduction
- What is CUDA?
- Comparison of CUDA, OpenCL, and SYCL
- Overview of CUDA features and architecture
- Setting up the Development Environment
Getting Started
- Creating a new CUDA project using Visual Studio Code
- Exploring the project structure and files
- Compiling and running the program
- Displaying the output using printf and fprintf
CUDA API
- Understanding the role of the CUDA API in host-side programming
- Using the CUDA API to query device information and capabilities
- Using the CUDA API to allocate and deallocate device memory
- Using the CUDA API to copy data between host and device
- Using the CUDA API to launch kernels and synchronize threads
- Using the CUDA API to handle errors and exceptions
CUDA C/C++
- Understanding the role of CUDA C/C++ in device-side programming
- Using CUDA C/C++ to write kernels that execute on the GPU and manipulate data
- Utilizing CUDA C/C++ data types, qualifiers, operators, and expressions
- Applying CUDA C/C++ built-in functions, such as math, atomic, and warp operations
- Using CUDA C/C++ built-in variables, such as threadIdx, blockIdx, and blockDim
- Leveraging CUDA C/C++ libraries, including cuBLAS, cuFFT, and cuRAND
CUDA Memory Model
- Understanding the differences between host and device memory models
- Using CUDA memory spaces, including global, shared, constant, and local memory
- Working with CUDA memory objects, such as pointers, arrays, textures, and surfaces
- Applying CUDA memory access modes, such as read-only, write-only, and read-write
- Understanding the CUDA memory consistency model and synchronization mechanisms
CUDA Execution Model
- Understanding the differences between host and device execution models
- Using CUDA threads, blocks, and grids to define parallelism
- Utilizing CUDA thread functions, such as threadIdx, blockIdx, and blockDim
- Applying CUDA block functions, such as __syncthreads and __threadfence_block
- Using CUDA grid functions, including gridDim, gridSync, and cooperative groups
Debugging
- Identifying common errors and bugs in CUDA programs
- Using the Visual Studio Code debugger to inspect variables, set breakpoints, and analyze the call stack
- Debugging CUDA programs on Linux using CUDA-GDB
- Detecting memory errors and leaks with CUDA-MEMCHECK
- Debugging and analyzing CUDA programs on Windows using NVIDIA Nsight
Optimization
- Understanding the factors that influence CUDA program performance
- Applying CUDA coalescing techniques to improve memory throughput
- Using CUDA caching and prefetching techniques to reduce memory latency
- Optimizing memory accesses and bandwidth using CUDA shared and local memory techniques
- Measuring and improving execution time and resource utilization through CUDA profiling tools
Requirements
- A solid understanding of the C/C++ language and parallel programming concepts
- Foundational knowledge of computer architecture and memory hierarchy
- Practical experience with command-line tools and code editors
Audience
- Developers seeking to learn how to use CUDA to program NVIDIA GPUs and exploit their parallelism
- Developers aiming to write high-performance, scalable code that can run on various CUDA-enabled devices
- Programmers interested in exploring the low-level aspects of GPU programming and optimizing code performance
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 5800 € + VAT*
Contact us for an exact quote and to hear our latest promotions