Re: clarification about temporary directory usage

[Carsten Sachse]

Hi Ambroise,

On Oct 17, 2014, at 0:20, Ambroise Desfosses wrote:

Hi Carsten,  

sorry to spam about Spring... But adaptation to the new cluster is somehow more painful than I hoped. We sometimes have our jobs running properly but often not and I am working on understanding underlying reasons. One problem that I have is that I can't figure out precisely what is the usage made by spring of the temporary folder, because I see there subfolders not containing always the same data (e.g., some contain the projection_stack and some other not. I join below a list of temporary folder created by one job, together with their disk space usage.). 

It sounds like your cluster is not set up to have large local scratch space for every node. Just use /scratch instead. This will also work but will be slower as this is probably a network disk. 

Every process, i.e. every CPU creates their own temporary directory. Large files, such as projection or else will create only one copy per node to keep the disk usage within reason. Small files will be created in every directory per CPU.

Best wishes,

Carsten

Thank you for your help, 

Ambroise



31G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_05-9965
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-9966
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-9967
30G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3718
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3719
274M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3720
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3721
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3722
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3723
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3724
30G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11121
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11122
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11123
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11124
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11125
274M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11126
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11127
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11128
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-11129
30G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13520
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13521
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13522
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13523
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13524
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13525
274M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13526
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13527
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-13528
30G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3386
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3387
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3388
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3389
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3390
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3391
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3392
274M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3393
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3394
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3395
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_06-3396
30G    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1353
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1354
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1355
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1356
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1357
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1358
274M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1359
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1360
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1361
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1362
276M    /scratch/jobs/xxx673/xxx673-16_Oct_2014_15_39_07-1363