暫無描述

Mike Mikailov 1b8619d5c6 Update readme.md		5 年之前
heatmap_stitch	740b0b5581 Rename dldp/dldp/heatmap_pred/HPC_SC20/heatmap_main.sh to dldp/dldp/heatmap_pred/HPC_SC20/heatmap_stitch/heatmap_main.sh	5 年之前
image_patch_extract	d5fa764ba4 Rename dldp/dldp/heatmap_pred/HPC_SC20/split_main.sh to dldp/dldp/heatmap_pred/HPC_SC20/image_patch_extract/split_main.sh	5 年之前
prediction	540a3e9c7b Rename dldp/dldp/heatmap_pred/HPC_SC20/process_array.sh to dldp/dldp/heatmap_pred/HPC_SC20/prediction/process_array.sh	5 年之前
readme.md	1b8619d5c6 Update readme.md	5 年之前
set_env.sh	850f3c1906 Rename dldp/dldp/heatmap_pred/set_env.sh to dldp/dldp/heatmap_pred/HPC_SC20/set_env.sh	5 年之前
time_all_stats_pred.sh	9fe317c112 Rename dldp/dldp/heatmap_pred/time_all_stats_pred.sh to dldp/dldp/heatmap_pred/HPC_SC20/time_all_stats_pred.sh	5 年之前

1 Image patch extraction
2 Prediction
3 Heatmap stitching 4 Retreiving run-time statistics

1 Image patch extraction

The following commands launch Son of Grid Engine (SGE) jobs to extract, group patches in HDF5 files and create a lookup tables for every HDF5 file.

1.1 Without color normalization

qsub split_main.sh ./config_testing.txt
qsub split_main.sh ./config_normal.txt
qsub split_main.sh ./config_tumor.txt

1.2 With color normalization

qsub split_main.sh ./config_testing_cn_true.txt
qsub split_main.sh ./config_normal.txt
qsub split_main.sh ./config_tumor.txt

1.3 Creating lookup tables

bash create_lookup_grp.sh ./config_testing.txt
bash create_lookup_grp.sh ./config_normal.txt
bash create_lookup_grp.sh ./config_tumor.txt

The lookup tables are created only once.

2 Prediction

The following commands launch Son of SGE jobs to generate prediction matrices.

2.1 With color normalization

qsub process_main.sh ./config_testing_cn_true.txt
qsub process_main.sh ./config_normal_cn_true.txt
qsub process_main.sh ./config_tumor_cn_true.txt

2.2 Without color normalization

qsub process_main.sh ./config_testing.txt
qsub process_main.sh ./config_normal.txt
qsub process_main.sh ./config_tumor.txt

3 Heatmap stitching

After the predictions matrices have been generated an SGE job using heatmap_main.sh SGE scrip could be launched to genertae heatmaps. Two arguments for this launch are: a) type of the slides (test, normal or tumor); b) the root directory of the results, like in below ecxample run:
qsub heatmap_main.sh test /scratch/mikem/UserSupport/weizhe.li/runs_process_cn_True/testing_wnorm_448_400_7690953

4 Retreiving run-time statistics

In time_all_stats_pred.sh file adjust job results root directory, like:
DIR=/scratch/mikem/UserSupport/weizhe.li/runs_process_cn_False/normal_wnorm_448_400_7691563
Then run: time bash ./time_all_stats_pred.sh

readme.md