setdefaulttensortype(torch.CudaTensor) bad practice?

[Yathindu Rangana]

Hi all,

Is it bad practice to call setdefaulttensortype(torch.CudaTensor)  at the start of the program? I imagine this would cause every tensor created to be on the GPU and waste memory?

Thanks!

[Simon Niklaus]

You might have difficulties with your training data. In general, you want that to reside in the main memory since the memory in you graphics card is limited. This practice might furthermore slow the data augmentation down since the data might need to be copied back to the main memory (depending on how the augmentation is implemented).

- Simon