Hi Charudatta Phatak,
One can use each GPU for a different calculation. I think it is not possible to do real distributed calculations of a single script. As Josh Lauzier mentioned it is possible to do a kind of batch system with mumax3-server. The other option is to use
mumax3 script1.txt script2.txt ... scriptn.txt
This will automatically distribute the script between the GPUs until all the scripts are finalized. It will occupy all the available GPU even if there is another mumax3 script running.
Best regards,
Felipe