N-Ways to Multi-GPU Programming

This repository contains applications for GPU Bootcamps. The lab currently under development is to enable multi-node multi-GPU programming using CUDA-aware MPI , NCCl, and NVHSHMEM with insights from NSight Systems and HPCToolkit profilers.