Re: How long it should take to create a default Hadoop cluster

[nbb...@gmail.com]

Hi Dido,

Can you try using ESXi 5.0 instead of 5.1?

There is a known issue on deploy speed of Serengeti on ESXi 5.1.

VC 5.1 is okay and you can just keep it.

10G network will definitely help.

Regards,

Binbin

On Friday, May 17, 2013 5:03:51 AM UTC+8, Dido Dontchev wrote:

Hi,

I am using Vcenter 5.1 in a 1G environment.

Installed Serengeti on a cluster consisting of 2 ESXi hosts PowerEdge R710s

DELL R710 System Configuration with 2 Quad core Intel Xeon processors 2.93GHz with 288GB of RAM

It takes about 1 hour to clone all the VMs and 1 more hour for configuration.

Storage is local on the ESXi servers, Vcenter is installed on another server with 1Gb connection between the ESXi host and Vcenter

Questions:

If we configure  a full 10G network, between VC and ESXi hosts, would that reduce Hadoop cluster deployment significantly?

What strategies can we utilize to further reduce the deployment time, we are plannng to deploy clusters with 50+ VMs simultaneously.


Thanks in advance.




DMD

[Dido Dontchev]

Binbin,

Thanks for your reply.  We can't go back to VC 5.0

Is there a fix for that issue that you are aware of?

Also do you suggest we put the entire managment network on 10G including the VC server or just the ESXis will suffice?

Thank you much.

DMD