Recommended memory for Selenium Nodes

4,048 views
Skip to first unread message

David Lai

unread,
Dec 6, 2013, 12:47:58 PM12/6/13
to seleniu...@googlegroups.com
HI,

I was wondering what is the recommended memory needed per a selenium node VM.

Currently I have probably a couple dozen nodes all running with 2GB ram each.  Seems like it runs ok most of the time, but pretty frequently enough a few of the nodes will take longer than expected to render one of our Single Page App pages.

I was wondering what everyone else was using in their selenium grid setup?  I'd like to keep as many VMs as possible so I can parallelize my test, but still have enough memory for each node.

Shawn McCarthy

unread,
Dec 7, 2013, 11:53:03 AM12/7/13
to seleniu...@googlegroups.com
How many max browsers do you allow per node ? Are they running Windows (7?) or Linux or ?

I have 4 windows 7 VMs. 3 of them have 4GB ram and 1 of them has 6GB ram. The one with 6GB of ram is the node and hub and jenkins server as well. I allow 6 max browsers per machine. I don't really have any research to back up why I chose those numbers, but I am interested in seeing what other people use.

Oscar Rieken

unread,
Dec 7, 2013, 12:01:55 PM12/7/13
to seleniu...@googlegroups.com
i have about 20 of each windows xp, vista, 7, 40 linux they are all nodes I run about 10-20 browsers on each with 8gb of ram each 
the hub I have on a seperate linux vm and its 32gb of ram there is also another box that actually executes the tests and that one is 32gb as well


--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to selenium-user...@googlegroups.com.
To post to this group, send email to seleniu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/89a8736d-f1d3-42e2-8d6e-a2ee71958ab5%40googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

Krishnan Mahadevan

unread,
Dec 12, 2013, 5:38:07 AM12/12/13
to Selenium Users
David,
If you are referring to some OutofMemoryErrors :

then from bothering about what should be the ideal memory value, I decided to move forward to something like a self healing grid environment

You can read more about what am I talking about here : 

I heard that the Grid was never profiled for memory leaks but I learnt that this can be circumvented by frequently restarting the node jar.

But then again the newer versions of selenium jar have scaled up leaps and bounds with respect to memory leaks.



Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/


David Lai

unread,
Dec 31, 2013, 4:28:41 PM12/31/13
to seleniu...@googlegroups.com
Shawn, I'm not running any parallel tests on any single node.  Each node is configured with IE or Safari (the default version that ships with the OS we're testing: XP, Win7, Win8, Win8.1, OSX 10.8, OSX 10.9, latest version of Firefox, and latest version of Chrome.  The max browsers per node is 1.  The VMs are running on ESX server for windows, and on VMWare fusion on Mac (using a mac pro to host this since the VM requires an intel mac cpu).  I believe all my VMs are running VMs configured with 1 core 2GHz, 2GB ram.  

 
Krishnan, I still have to get around to looking into that self healing grid idea.  I skimmed it when you answered another question of mine about implementing a drain functionality for seamless upgrades.  I wasn't able to quickly incorporate that since I run in a python shop and using python for almost everything.

Yeah, I have a combination of different issues.  The java memory leaks is one.  Another is sometimes a browser would hang, and subsequent tests would fail if they ran on that node.  On Safari VMs, I have tons open console windows, for some reason the Selenium Nodes on macs don't clean the console windows they spawn. 
Reply all
Reply to author
Forward
0 new messages