GPU Programming

GPU Computing Fundamentals Tutorial with Examples.

GPU computing tutorial for beginners: core architecture concepts like SIMT execution, memory coalescing, occupancy and hardware parallelism.

1 Beginner 1 Intermediate 1 Advanced

Beginner

Start here — no prior experience needed

1 lesson

gpu-fundamentals beginner

5 min read

GPU Fundamentals: SIMT & Memory Hierarchy

Learn SIMT execution, warps, branch divergence and the GPU memory hierarchy (registers, shared, L2, DRAM) from CUDA programs run on a real T4.

Read Tutorial

Intermediate

For developers with core concepts down

1 lesson

gpu-fundamentals intermediate

5 min read

GPU Fundamentals: Coalescing & Occupancy

Measure how coalesced memory access and occupancy change GPU bandwidth, with CUDA programs timed on a real Tesla T4: strides, layouts and block sizes.

Read Tutorial

Advanced

Production-grade patterns for experienced engineers

1 lesson

gpu-fundamentals advanced

5 min read

GPU Fundamentals: Profiling Metrics & Roofline

Use the roofline model, CUDA event timing, Nsight Compute and Nsight Systems on a real Tesla T4 to tell memory-bound kernels from compute-bound ones.

Read Tutorial