瀏覽代碼

Developing multi-GPU programming bootcamp

sft-managed 2 年之前
父節點
當前提交
0ed490038d
共有 85 個文件被更改,包括 352 次插入0 次删除
  1. 3 0
      .gitmodules
  2. 1 0
      hpc/multi_gpu_nways/Dockerfile
  3. 5 0
      hpc/multi_gpu_nways/README.md
  4. 1 0
      hpc/multi_gpu_nways/Singularity
  5. 1 0
      hpc/multi_gpu_nways/labs/CFD/English/C/source_code/multi-gpu-programming-models
  6. 91 0
      hpc/multi_gpu_nways/labs/CFD/English/mgp_01_begin.ipynb
  7. 23 0
      hpc/multi_gpu_nways/labs/profiler/English/LICENSE
  8. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/Nsight Diagram.png
  9. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/Optimization_Cycle.jpg
  10. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/UM.png
  11. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/allsection-compute.png
  12. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/baseline-compute.png
  13. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/charts-compute.png
  14. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cli-out.png
  15. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_feedback.png
  16. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_pre.png
  17. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_thread.png
  18. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute.png
  19. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_analyz.png
  20. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_command.png
  21. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_command_line.png
  22. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_open.png
  23. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cpu.png
  24. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda.png
  25. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_hw_sw.png
  26. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_indexing.png
  27. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_vec_add.png
  28. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/data_feedback.png
  29. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/data_thread.png
  30. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/diagram.png
  31. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_128.png
  32. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_256.png
  33. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_32.png
  34. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_vector.png
  35. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gpu_feedback.png
  36. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kernel_feedback.png
  37. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kernel_indep_feedback.png
  38. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_abstraction.png
  39. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_ecosystem.png
  40. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_mirror_view.png
  41. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/laplas3.png
  42. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/launch-compute.png
  43. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nsight_open.png
  44. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx.PNG
  45. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_gpu.png
  46. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_multicore.png
  47. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_serial.png
  48. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc correlation.png
  49. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_3_directives.png
  50. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_construct.png
  51. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_copyclause.png
  52. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel.png
  53. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel2.png
  54. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel_loop.png
  55. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_fork_join.png
  56. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_parallel_construct.png
  57. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_parallelfor_construct.png
  58. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_target_distribute.png
  59. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_target_teams.png
  60. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_teams.png
  61. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_teams_for.png
  62. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/page-compute.png
  63. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_data.png
  64. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_data_feedback.png
  65. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_detailed.png
  66. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_expand.png
  67. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_loop.png
  68. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_timeline.png
  69. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_unified.png
  70. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/rdf.png
  71. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/roofline_collapse.png
  72. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/rule-compute.png
  73. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/scheduler_collapse.png
  74. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/serial.png
  75. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/sol.png
  76. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/sol_baseline.png
  77. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_collapse.png
  78. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_hover.png
  79. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_loc.png
  80. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_sass_collapse.png
  81. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/summary-compute.png
  82. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/thread.png
  83. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/warp_collapse.png
  84. 二進制
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/workflow.png
  85. 227 0
      hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/profiling-c.ipynb

+ 3 - 0
.gitmodules

@@ -0,0 +1,3 @@
+[submodule "hpc/multi_gpu_nways/labs/CFD/English/C/source_code/multi-gpu-programming-models"]
+	path = hpc/multi_gpu_nways/labs/CFD/English/C/source_code/multi-gpu-programming-models
+	url = https://github.com/Anish-Saxena/multi-gpu-programming-models.git

+ 1 - 0
hpc/multi_gpu_nways/Dockerfile

@@ -0,0 +1 @@
+# To be populated

+ 5 - 0
hpc/multi_gpu_nways/README.md

@@ -0,0 +1,5 @@
+# N-Ways to Multi-GPU Programming
+
+This repository contains applications for GPU Bootcamps. The lab currently under development is to enable multi-node multi-GPU programming using CUDA-aware MPI , NCCl, and NVHSHMEM with insights from NSight Systems and HPCToolkit profilers.
+
+### To be populated

+ 1 - 0
hpc/multi_gpu_nways/Singularity

@@ -0,0 +1 @@
+# To be populated

+ 1 - 0
hpc/multi_gpu_nways/labs/CFD/English/C/source_code/multi-gpu-programming-models

@@ -0,0 +1 @@
+Subproject commit 5c21895b8fa7ec36adc1f38f454a5e95dde9ae48

File diff suppressed because it is too large
+ 91 - 0
hpc/multi_gpu_nways/labs/CFD/English/mgp_01_begin.ipynb


+ 23 - 0
hpc/multi_gpu_nways/labs/profiler/English/LICENSE

@@ -0,0 +1,23 @@
+Copyright (c) 2018, National Center for Computational Sciences, Oak Ridge National Laboratory
+All rights reserved.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are met:
+
+* Redistributions of source code must retain the above copyright notice, this
+  list of conditions and the following disclaimer.
+
+* Redistributions in binary form must reproduce the above copyright notice,
+  this list of conditions and the following disclaimer in the documentation
+  and/or other materials provided with the distribution.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/Nsight Diagram.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/Optimization_Cycle.jpg


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/UM.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/allsection-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/baseline-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/charts-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cli-out.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_pre.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/collapse_thread.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_analyz.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_command.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_command_line.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/compute_open.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cpu.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_hw_sw.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_indexing.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/cuda_vec_add.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/data_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/data_thread.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/diagram.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_128.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_256.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_32.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gang_vector.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/gpu_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kernel_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kernel_indep_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_abstraction.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_ecosystem.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/kokkos_mirror_view.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/laplas3.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/launch-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nsight_open.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx.PNG


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_gpu.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_multicore.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/nvtx_serial.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc correlation.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_3_directives.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_construct.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_copyclause.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel2.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openacc_parallel_loop.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_fork_join.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_parallel_construct.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_parallelfor_construct.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_target_distribute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_target_teams.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_teams.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/openmp_teams_for.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/page-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_data.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_data_feedback.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_detailed.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_expand.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_loop.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_timeline.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/parallel_unified.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/rdf.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/roofline_collapse.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/rule-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/scheduler_collapse.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/serial.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/sol.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/sol_baseline.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_collapse.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_hover.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_loc.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/source_sass_collapse.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/summary-compute.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/thread.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/warp_collapse.png


二進制
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/images/workflow.png


File diff suppressed because it is too large
+ 227 - 0
hpc/multi_gpu_nways/labs/profiler/English/jupyter_notebook/profiling-c.ipynb