verified param cnt, rm intro notebooks

ai/Megatron/English/Python/Start_Here.ipynb

@@ -261,7 +261,7 @@
     "\n",
     "The following contents will be covered during the Bootcamp :\n",
     "\n",
-    "- [**Introduction and outlines of Day 2**](./jupyter_notebook/Day2_0_intro.ipynb)\n",
+    "- **Outlines of Day 2**\n",
     "    Megatron 101 in half a day \n",
     "    - [Estimate hours/days needed to execute one end-to-end run per Megatron configuration](./jupyter_notebook/Day2-1_EstimateComputeDaysNeeded.ipynb)\n",
     "    - [Understanding the core of Megatron - mpu ](./jupyter_notebook/Day2-2_MegatronFundementals.ipynb)\n",
@@ -270,7 +270,7 @@
     "    - [Megatron runs vs config](./jupyter_notebook/Day2-5_Observe_GPT_runs_vs_performance.ipynb)\n",
     "    - [challenge - the best profiler](./jupyter_notebook/Day2-5_Observe_GPT_runs_vs_performance.ipynb#TheChallenge)\n",
     "\n",
-    "- [**Day 3 outlines **](./jupyter_notebook/Day3-0_overview.ipynb)\n",
+    "- **Outlines of Day 3**\n",
     "    Getting started on training your own Megatron GPT models !\n",
     "    - [Fetch and extract Swedish data](./jupyter_notebook/Megatron-LM/tools/openwebtext/Day3-1_acquiring_data.ipynb)\n",
     "    - [Find sentence boundary and deduplicate your data](./jupyter_notebook/Megatron-LM/tools/openwebtext/Day3-2_SentenceBoundary_and_Deduplicate.ipynb)\n",

ai/Megatron/English/Python/jupyter_notebook/Day3-5_run_Megatron_with_varying_config.ipynb

@@ -2,7 +2,7 @@
  "cells": [
   {
    "cell_type": "markdown",
-   "id": "theoretical-diary",
+   "id": "posted-subcommittee",
    "metadata": {},
    "source": [
     "# Monitor GPT training performance with varying config\n",
@@ -48,7 +48,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "gross-macro",
+   "id": "turned-lender",
    "metadata": {},
    "source": [
     "---\n",
@@ -60,7 +60,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "human-classics",
+   "id": "controlling-advertiser",
    "metadata": {},
    "source": [
     "---\n",
@@ -72,7 +72,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "finnish-think",
+   "id": "improving-speech",
    "metadata": {},
    "source": [
     "<a id=\"Rerun_Cell\"></a>"
@@ -81,7 +81,7 @@
   {
    "cell_type": "code",
    "execution_count": 1,
-   "id": "saving-locator",
+   "id": "sharing-headline",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -91,7 +91,7 @@
   {
    "cell_type": "code",
    "execution_count": 2,
-   "id": "adverse-genetics",
+   "id": "warming-brooklyn",
    "metadata": {},
    "outputs": [
     {
@@ -173,19 +173,19 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ecological-delaware",
+   "id": "protective-private",
    "metadata": {},
    "source": [
     "---\n",
     "## Check how big is your model - \n",
     "modify the parameters in the [params_cnt.sh](./params_cnt.sh)\n",
-    "I got 6 Billion :)  what about you ?"
+    "I got 6.6 Billion :)  what about you ?"
    ]
   },
   {
    "cell_type": "code",
    "execution_count": 3,
-   "id": "latin-granny",
+   "id": "pretty-laser",
    "metadata": {},
    "outputs": [
     {
@@ -203,7 +203,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "widespread-sunset",
+   "id": "acknowledged-thinking",
    "metadata": {},
    "source": [
     "---\n",
@@ -227,7 +227,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "standing-change",
+   "id": "imperial-fellowship",
    "metadata": {},
    "source": [
     "---\n",
@@ -243,7 +243,7 @@
   {
    "cell_type": "code",
    "execution_count": 4,
-   "id": "novel-campbell",
+   "id": "continued-yahoo",
    "metadata": {},
    "outputs": [
     {
@@ -550,7 +550,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "center-microphone",
+   "id": "available-relaxation",
    "metadata": {},
    "source": [
     "--- \n",
@@ -564,7 +564,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "basic-horror",
+   "id": "naked-lodge",
    "metadata": {},
    "source": [
     "---\n",
@@ -574,7 +574,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "recovered-pleasure",
+   "id": "compound-tonight",
    "metadata": {},
    "source": [
     "-----\n",