HPC-AI-Healthcare-Training

High Performance Cluster (HPC) short tutorial for UCL AI-Enabled Healthcare CDT

How does it work?

Logging In

Scheduler

###qsub Submit a job to the scheduler with qsub

qsub /path/to/submission/script/

###qstat Get the status of a job with qstat

qstat
job-ID  prior   name       user         state submit/start at     queue                          slots ja-task-ID 
-----------------------------------------------------------------------------------------------------------------
6506636 0.00000 testing    jbloggs      qw    21/12/2012 11:11:11                                    1     
qstat -j <job-ID>

###q Submit a job to the scheduler with qsub

qsub /path/to/submission/script/

Why use the HPC?

• No CUDA enabled GPU on your laptop
• Don’t want your laptop to become a radiator
• Run parallel experiments and get results quicker
• Hyper optimization
• BIG GPU’s
• Free service
• Relatively high freedom to manage your own environment
• Learn key skills for industry
• Secure place to store healthcare data
• Active support

Why not use the HPC?

• Takes time to setup
• Job queue times
• Unix is hard and ugly
• Unfamiliar environment
• I have a huge GPU in my desktop it’s enough for what I want to do
• Prefer to learn commercial cloud services (AWS GCP AZURE)