Using GAMA on a HPC cluster with multiple nodes for a single simulation

92 views
Skip to first unread message

Chintan Pathak

unread,
Nov 22, 2019, 11:58:44 PM11/22/19
to GAMA
Dear all,

As I understood from previous posts on the google groups, we can use the "parallel" facet of the experiment to run multiple simulations in parallel. But if I just wanted to run the one simulation, what are the scalability options available? **(All the discussion is pertaining to the headless mode)**

Does a single simulation use all the cores on the machine? The headless mode output does start my listing the number of available CPUs, but after reading the runtime concepts it is not clear if a single simulation can and does utilize multiple cores.

Further, can a simulation be scaled to multiple nodes like one does using MPI?

My simulation takes 3 hours with 1200 EV agents, and around 6 hours with 2000 EV agents. So the paper reviewers have raised concerns about scalability. While, I am working on optimizing the runtime using better GAMA constructs, I think also exploring the distributed computation possibility feels prudent.

Thanks

Nicolas Marilleau

unread,
Nov 25, 2019, 1:26:18 AM11/25/19
to gama-p...@googlegroups.com
Hi, 

The headless mode is mainly used to run several simulations on a grid or cluster without any GUI. The main gain of this method in term of performance is to allocate CPUs (usually used by GUI) for playing simulations. Thus you can play more simulations in parallel with the same number of cores. 

Nevertheless, if you want to distribute one simulation on cores of a CPU, maybe you can use co-modeling approaches built in GAMA. 

If you want an MPI like distributed model, you should develop your own distribution scheme by using Network plugin. It implies to develop your own scheduler, your own consistency algorithm and so one…

Best regards
Nicolas

If you want to distribute one simulation 
Nicolas Marilleau
UMI 209 UMMISCO IRD/UPMC
Chercheur invité Femto-st

Institut de Recherche pour le Développement 
32 avenue Henri Varagnat
93143 Bondy 
Fixe : 0148027901
Mobile: 0688334906





--
You received this message because you are subscribed to the Google Groups "GAMA" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gama-platfor...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/ef1633a2-46c5-4ac2-b757-6cac63b25831%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages