Auto Scaling in Qubole

[justin...@gmail.com]

Hi,

I am going through the docs and trying to understand the auto-scaling concept in Qubole. Is Auto-scaling feature time bound? For eg: While executing a Hive command, if I set a time boundary that the command execution needs to be completed in 1 hour, is it fair to say that Qubole sizes the cluster based on these time requirements and attempts to finish the command execution with in the specified time?

Regards,

Justin

[Ashish Dubey]

Justin, 

That is true but hadoop jobs are tricky so not that straightforward - some components of your jobs  might not be predictable because those components also rely on data values. So considering all the aspects, yes we aim to finish you tasks within a certain time and based on that come up with the number of nodes which should be added to the cluster..Although autoscaling feature is quite comprehensive and takes care of lot of other aspects.

Would you also please describe your use case and if needed i can connect you to the team members who can give you more detailed information on your question.

thanks,

Ashish 

--
You received this message because you are subscribed to the Google Groups "Qubole Public Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to qubole-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/qubole-users/c90f6132-1762-46d7-8308-75cb0eff8f8a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,

Ashish Dubey

Solutions Architect | +1-510-298-9147

Follow us on @Qubole | Qubole - The Best Big Data Platform on the Cloud. 

Qubole has been named to @CNBC’s ultimate list of disruptive companies! See the whole list: disruptor50.cnbc.com