Get in Touch
 Duration 28 hours

Course Outline

Introduction

  • What is CUDA?
  • Comparison of CUDA, OpenCL, and SYCL
  • Overview of CUDA features and architecture
  • Setting up the Development Environment

Getting Started

  • Creating a new CUDA project using Visual Studio Code
  • Exploring the project structure and files
  • Compiling and running the program
  • Displaying the output using printf and fprintf

CUDA API

  • Understanding the role of the CUDA API in host-side programming
  • Using the CUDA API to query device information and capabilities
  • Using the CUDA API to allocate and deallocate device memory
  • Using the CUDA API to copy data between host and device
  • Using the CUDA API to launch kernels and synchronize threads
  • Using the CUDA API to handle errors and exceptions

CUDA C/C++

  • Understanding the role of CUDA C/C++ in device-side programming
  • Using CUDA C/C++ to write kernels that execute on the GPU and manipulate data
  • Utilizing CUDA C/C++ data types, qualifiers, operators, and expressions
  • Applying CUDA C/C++ built-in functions, such as math, atomic, and warp operations
  • Using CUDA C/C++ built-in variables, such as threadIdx, blockIdx, and blockDim
  • Leveraging CUDA C/C++ libraries, including cuBLAS, cuFFT, and cuRAND

CUDA Memory Model

  • Understanding the differences between host and device memory models
  • Using CUDA memory spaces, including global, shared, constant, and local memory
  • Working with CUDA memory objects, such as pointers, arrays, textures, and surfaces
  • Applying CUDA memory access modes, such as read-only, write-only, and read-write
  • Understanding the CUDA memory consistency model and synchronization mechanisms

CUDA Execution Model

  • Understanding the differences between host and device execution models
  • Using CUDA threads, blocks, and grids to define parallelism
  • Utilizing CUDA thread functions, such as threadIdx, blockIdx, and blockDim
  • Applying CUDA block functions, such as __syncthreads and __threadfence_block
  • Using CUDA grid functions, including gridDim, gridSync, and cooperative groups

Debugging

  • Identifying common errors and bugs in CUDA programs
  • Using the Visual Studio Code debugger to inspect variables, set breakpoints, and analyze the call stack
  • Debugging CUDA programs on Linux using CUDA-GDB
  • Detecting memory errors and leaks with CUDA-MEMCHECK
  • Debugging and analyzing CUDA programs on Windows using NVIDIA Nsight

Optimization

  • Understanding the factors that influence CUDA program performance
  • Applying CUDA coalescing techniques to improve memory throughput
  • Using CUDA caching and prefetching techniques to reduce memory latency
  • Optimizing memory accesses and bandwidth using CUDA shared and local memory techniques
  • Measuring and improving execution time and resource utilization through CUDA profiling tools

Requirements

  • A solid understanding of the C/C++ language and parallel programming concepts
  • Foundational knowledge of computer architecture and memory hierarchy
  • Practical experience with command-line tools and code editors

Audience

  • Developers seeking to learn how to use CUDA to program NVIDIA GPUs and exploit their parallelism
  • Developers aiming to write high-performance, scalable code that can run on various CUDA-enabled devices
  • Programmers interested in exploring the low-level aspects of GPU programming and optimizing code performance

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 5800 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Upcoming Courses

Related Categories