Home Explore Help
Sign In
RONCC
/
NVIDIA-GPU-Bootcamp-Training
Watch 1
Star 0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Browse Source

implement proof-reading thanks to Millie T

zenodia 3 years ago
parent
4ad921a7fd
commit
6e9663ce87
100 changed files with 0 additions and 0 deletions
Split View Show Diff Stats
  1. 0 0
      ai/Megatron/English/Python/Start_Here.ipynb
  2. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab1-2_EstimateComputeDaysNeeded.ipynb
  3. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab1-3_MegatronFundementals.ipynb
  4. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab1-4_GPT_vocab_merge_files.ipynb
  5. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab1-5_jsonfy_and_process2mmap.ipynb
  6. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab1-6_Observe_GPT_runs_vs_performance.ipynb
  7. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab2-3_train_own_GPT2BPETokenizer.ipynb
  8. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab2-4_customize_process2mmap.ipynb
  9. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Lab2-5_run_Megatron_with_varying_config.ipynb
  10. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/Dlprof_pretrain_gpt.py
  11. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/LICENSE
  12. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/MANIFEST.in
  13. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/README.md
  14. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/SV_preprocess_gpt.sh
  15. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/evaluate_retriever_nq.sh
  16. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5.sh
  17. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5_distributed.sh
  18. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5_distributed_with_mp.sh
  19. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/images/cases_april2021.png
  20. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__init__.py
  21. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/__init__.cpython-38.pyc
  22. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/arguments.cpython-38.pyc
  23. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/checkpointing.cpython-38.pyc
  24. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/global_vars.cpython-38.pyc
  25. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/initialize.cpython-38.pyc
  26. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/learning_rates.cpython-38.pyc
  27. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/memory.cpython-38.pyc
  28. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/microbatches.cpython-38.pyc
  29. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/p2p_communication.cpython-38.pyc
  30. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/package_info.cpython-38.pyc
  31. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/schedules.cpython-38.pyc
  32. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/training.cpython-38.pyc
  33. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/utils.cpython-38.pyc
  34. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/arguments.py
  35. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/checkpointing.py
  36. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/Makefile
  37. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__init__.py
  38. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/__init__.cpython-38.pyc
  39. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/blendable_dataset.cpython-38.pyc
  40. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/data_samplers.cpython-38.pyc
  41. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/dataset_utils.cpython-38.pyc
  42. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/gpt_dataset.cpython-38.pyc
  43. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/indexed_dataset.cpython-38.pyc
  44. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/autoaugment.py
  45. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/bert_dataset.py
  46. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/biencoder_dataset_utils.py
  47. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/blendable_dataset.py
  48. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/data_samplers.py
  49. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/dataset_utils.py
  50. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/gpt_dataset.py
  51. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/helpers.cpp
  52. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/ict_dataset.py
  53. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/indexed_dataset.py
  54. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/orqa_wiki_dataset.py
  55. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/realm_dataset_utils.py
  56. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/realm_index.py
  57. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/t5_dataset.py
  58. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/test/test_indexed_dataset.py
  59. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/vit_dataset.py
  60. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/__init__.py
  61. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/__pycache__/__init__.cpython-38.pyc
  62. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/.ninja_deps
  63. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/.ninja_log
  64. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/build.ninja
  65. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/compat.h
  66. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/layer_norm_cuda.cpp
  67. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/layer_norm_cuda_kernel.cu
  68. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax.cpp
  69. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax.h
  70. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax_cuda.cu
  71. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax.cpp
  72. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h
  73. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax_cuda.cu
  74. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/type_shim.h
  75. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/global_vars.py
  76. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/indexer.py
  77. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/initialize.py
  78. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/learning_rates.py
  79. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/memory.py
  80. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/microbatches.py
  81. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__init__.py
  82. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/__init__.cpython-38.pyc
  83. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/bert_model.cpython-38.pyc
  84. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/distributed.cpython-38.pyc
  85. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/enums.cpython-38.pyc
  86. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_bias_gelu.cpython-38.pyc
  87. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_layer_norm.cpython-38.pyc
  88. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_softmax.cpython-38.pyc
  89. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/gpt_model.cpython-38.pyc
  90. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/language_model.cpython-38.pyc
  91. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/module.cpython-38.pyc
  92. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/t5_model.cpython-38.pyc
  93. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/transformer.cpython-38.pyc
  94. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/utils.cpython-38.pyc
  95. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/bert_model.py
  96. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/biencoder_model.py
  97. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/classification.py
  98. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/distributed.py
  99. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/enums.py
  100. 0 0
      ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/fused_bias_gelu.py

+ 0 - 0
ai/Megatron/English/Python/Start_Here.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab1-2_EstimateComputeDaysNeeded.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab1-3_MegatronFundementals.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab1-4_GPT_vocab_merge_files.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab1-5_jsonfy_and_process2mmap.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab1-6_Observe_GPT_runs_vs_performance.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab2-3_train_own_GPT2BPETokenizer.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab2-4_customize_process2mmap.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Lab2-5_run_Megatron_with_varying_config.ipynb
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/Dlprof_pretrain_gpt.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/LICENSE
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/MANIFEST.in
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/README.md
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/SV_preprocess_gpt.sh
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/evaluate_retriever_nq.sh
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5.sh
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5_distributed.sh
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/examples/pretrain_t5_distributed_with_mp.sh
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/images/cases_april2021.png
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__init__.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/__init__.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/arguments.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/checkpointing.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/global_vars.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/initialize.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/learning_rates.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/memory.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/microbatches.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/p2p_communication.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/package_info.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/schedules.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/training.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/__pycache__/utils.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/arguments.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/checkpointing.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/Makefile
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__init__.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/__init__.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/blendable_dataset.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/data_samplers.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/dataset_utils.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/gpt_dataset.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/__pycache__/indexed_dataset.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/autoaugment.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/bert_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/biencoder_dataset_utils.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/blendable_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/data_samplers.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/dataset_utils.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/gpt_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/helpers.cpp
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/ict_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/indexed_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/orqa_wiki_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/realm_dataset_utils.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/realm_index.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/t5_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/test/test_indexed_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/data/vit_dataset.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/__init__.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/__pycache__/__init__.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/.ninja_deps
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/.ninja_log
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/build/build.ninja
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/compat.h
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/layer_norm_cuda.cpp
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/layer_norm_cuda_kernel.cu
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax.cpp
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax.h
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_masked_softmax_cuda.cu
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax.cpp
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/scaled_upper_triang_masked_softmax_cuda.cu
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/fused_kernels/type_shim.h
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/global_vars.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/indexer.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/initialize.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/learning_rates.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/memory.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/microbatches.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__init__.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/__init__.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/bert_model.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/distributed.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/enums.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_bias_gelu.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_layer_norm.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/fused_softmax.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/gpt_model.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/language_model.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/module.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/t5_model.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/transformer.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/__pycache__/utils.cpython-38.pyc
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/bert_model.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/biencoder_model.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/classification.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/distributed.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/enums.py
View File


+ 0 - 0
ai/Megatron/English/Python/jupyter_notebook/Megatron-LM/megatron/model/fused_bias_gelu.py
View File


Some files were not shown because too many files changed in this diff