Apache BigTop support

[Eron Wright]

What is the plan with respect to Apache BigTop?    Is the "Apache" distribution in Serengeti actually BigTop?

Thanks

[Jesse Hu]

Serengeti can support BigTop, and it's in our plan already.  Apache distribution supported in Serengeti is based on tarball not yum in Bigtop.  If you want to try Bigtop now, we can give you a guide how to do it.

Do you want to deploy Apache Hadoop 1 or Apache Hadoop 2 via Bigtop?

Thanks
Jesse Hu,  Project Serengeti

[Eron Wright]

Thanks a lot for the prompt reply.  I do want to try Bigtop now (Hadoop 2 in particular).  

Thanks

[Eron Wright]

Yes please, I would like to try BigTop + Hadoop 2.  Some instructions would be great!

Thanks

On Tuesday, August 27, 2013 8:43:40 PM UTC-7, Jesse Hu wrote:

Serengeti can support BigTop, and it's in our plan already.  Apache distribution supported in Serengeti is based on tarball not yum in Bigtop.  If you want to try Bigtop now, we can give you a guide how to do it.

Do you want to deploy Apache Hadoop 1 or Apache Hadoop 2 via Bigtop?

Thanks

Jesse Hu,  Project Serengeti

2013/8/28 Eron Wright <eronw...@gmail.com>

What is the plan with respect to Apache BigTop?    Is the "Apache" distribution in Serengeti actually BigTop?

Thanks

--
 
---
You received this message because you are subscribed to the Google Groups "serengeti-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to serengeti-de...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Jesse Hu]

That's great. Please follow this guide :

1) Download and install the latest Serengeti
2) [Optional] Create a local yum repo for Bigtop http://www.apache.org/dist/bigtop/stable/repos/centos5/bigtop.repo (it's v0.6.0 now)
3) Login Serengeti Server as user serengeti, and add a new distro bigtop in /opt/serengeti/www/distros/manifest (i.e. add the following content into this file).

  {
    "name" : "bigtop",
    "vendor" : "CDH",  // currently we don't support BIGTOP as vendor, so use CDH instead to simulate BIGTOP, since CDH4 rpms is based on Bigtop.
    "version" : "4",
    "packages" : [
      {
        "roles" : ["hadoop_namenode", "hadoop_datanode", "hadoop_resourcemanager", "hadoop_nodemanager", "hadoop_journalnode", "hadoop_client", "hive", "hive_server", "pig", "hbase_master", "hbase_regionserver", "hbase_client", "zookeeper"],
        "package_repos" : ["http://url/to/bigtop.repo"]
      }
    ]
  }

4) restart tomcat : sudo service tomcat restart
5) login serengeti cli:  serengeti
6) create Bigtop cluster: cluster create --name bigtop --distro bigtop --specFile /opt/serengeti/samples/default_hadoop_yarn_cluster.json

Thanks
Jesse

[Jesse Hu]

Hi Eron,

VMware Big Data Extension 1.1 (i.e. Serengeti) was released in Jan 2014 : https://www.vmware.com/support/pubs/vsphere-big-data-extensions-pubs.html .  We provide a patch for BDE 1.1 (http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2069237) to support HDP 2.0 and Bigtop 0.7.0+ (Apache Hadoop 2.0).  You can try it out.  You need to run this command to add the Bigtop distro in BDE:  config-distro.rb --name bigtop --vendor BIGTOP --version 0.7.0 -r http://url_to/bigtop.repo

Thanks
Jesse

On Thursday, August 29, 2013 9:43:23 AM UTC+8, Eron Wright wrote: