Technical AIintermediateVideo + quiz

Build and Run GPU Infrastructure for AI

For ML engineers, MLOps and platform engineers, infrastructure architects and DevOps people who know Linux, Python and basic containers.

39 lessons · 2.0 hours
Watch the first lesson freeWelcome · 3 min

Sign in to watch one lesson from this course free.

What you will be able to do

Explain what limits a GPU and how CUDA and its libraries fit togetherProfile a training step and train on one GPU and many with DDP and FSDP2Size a cluster for memory, GPU count, interconnect, storage and powerRun GPUs in containers and on Kubernetes with Dynamic Resource Allocation, sharing and queuesServe models with vLLM or similar engines and load-test them for latency and throughputWeigh a managed API, rented GPUs and your own cluster on cost, then monitor and secure the fleet

Skills you will gain

  • GPU architecture
  • CUDA stack
  • Distributed training
  • Cluster sizing
  • Kubernetes for GPUs
  • Inference serving

About this course

For ML engineers, MLOps and platform engineers, infrastructure architects and DevOps people who know Linux, Python and basic containers. Plan, build, run and pay for GPU infrastructure for AI training and serving as it stands in November 2026: how GPUs work and what limits them, CUDA and its libraries, training on one GPU and many with DDP, FSDP2 and checkpoints, interconnects, storage and cluster sizing, GPUs in containers and on Kubernetes with Dynamic Resource Allocation, sharing and queues, serving engines such as vLLM and Dynamo, cloud capacity, cost, monitoring and security. Follow Galebrook Analytics as it sizes and runs its own models, then load-test a model server and size a fleet yourself in a free lab.

Technical AI

Curriculum

9 modules · 39 lessons · 2.0h

Requirements

Linux and a terminal you are comfortable in
Python and a little PyTorch
Basic Docker and Kubernetes

What you walk away with

A Yallo AI academy certificate of completion, issued when every lesson is complete and the final assessment is passed at 70% or aboveA public verification page, so a stranger can check the certificate without asking you for a filePDF download, and a one-click share to your LinkedIn profile

Yallo AI academy certifies completion of

Build and Run GPU Infrastructure for AI