|
|
@@ -1,5 +1,38 @@
|
|
|
# High Performance Cluster (HPC) short tutorial for UCL AI-Enabled Healthcare CDT
|
|
|
|
|
|
+## Why use the HPC?
|
|
|
+* No CUDA enabled GPU on your laptop
|
|
|
+* Don’t want your laptop to become a radiator
|
|
|
+* Run parallel experiments and get results quicker
|
|
|
+* Hyperparameter optimization
|
|
|
+* BIG GPU’s
|
|
|
+* Free service
|
|
|
+* Relatively high freedom to manage your own environment
|
|
|
+* Learn key skills for industry
|
|
|
+* Secure place to store healthcare data
|
|
|
+* Active support
|
|
|
+
|
|
|
+## Why not use the HPC?
|
|
|
+* Takes time to setup
|
|
|
+* Job queue times
|
|
|
+* Unix is hard and ugly
|
|
|
+* Unfamiliar environment
|
|
|
+* I have a huge GPU in my desktop it’s enough for what I want to do
|
|
|
+* Prefer to learn commercial cloud services (AWS GCP AZURE)
|
|
|
+
|
|
|
+## Getting access
|
|
|
+
|
|
|
+First of all, it's worth checking if your supervisor already has accesss to HPC services and then requesting an account there.
|
|
|
+
|
|
|
+If not you can request an account:
|
|
|
+* CS HPC at https://hpc.cs.ucl.ac.uk/account-form/
|
|
|
+* UCL Research Center at https://signup.rc.ucl.ac.uk/computing/requests/new
|
|
|
+
|
|
|
+This guide is going to use the CS HPC cluster but both should be similar.
|
|
|
+
|
|
|
+The IHI is also in the process so procuring its own HPC services but we're not there yet :(.
|
|
|
+
|
|
|
+
|
|
|
## How does it work?
|
|
|
|
|
|
|
|
|
@@ -17,7 +50,7 @@ Submit a job to the scheduler with qsub
|
|
|
```bash
|
|
|
qsub /path/to/submission/script/
|
|
|
```
|
|
|
-###qstat
|
|
|
+### qstat
|
|
|
Get the status of a job with qstat
|
|
|
```bash
|
|
|
qstat
|
|
|
@@ -27,7 +60,7 @@ job-ID prior name user state submit/start at queue
|
|
|
qstat -j <job-ID>
|
|
|
```
|
|
|
|
|
|
-###q
|
|
|
+### q
|
|
|
Submit a job to the scheduler with qsub
|
|
|
```bash
|
|
|
qsub /path/to/submission/script/
|
|
|
@@ -35,23 +68,4 @@ qsub /path/to/submission/script/
|
|
|
|
|
|
|
|
|
|
|
|
-## Why use the HPC?
|
|
|
-* No CUDA enabled GPU on your laptop
|
|
|
-* Don’t want your laptop to become a radiator
|
|
|
-* Run parallel experiments and get results quicker
|
|
|
-* Hyper optimization
|
|
|
-* BIG GPU’s
|
|
|
-* Free service
|
|
|
-* Relatively high freedom to manage your own environment
|
|
|
-* Learn key skills for industry
|
|
|
-* Secure place to store healthcare data
|
|
|
-* Active support
|
|
|
-
|
|
|
-## Why not use the HPC?
|
|
|
-* Takes time to setup
|
|
|
-* Job queue times
|
|
|
-* Unix is hard and ugly
|
|
|
-* Unfamiliar environment
|
|
|
-* I have a huge GPU in my desktop it’s enough for what I want to do
|
|
|
-* Prefer to learn commercial cloud services (AWS GCP AZURE)
|
|
|
|
Qndre