3Node Hadoop cluster setup with Mongo DB-steps

[bibhu patnaik]

Client having their Own Face book/Twitter/Linkdin account, as per the requirement All the data from Face book/Twitter/LinkedIn should be dump in MongoDB. Data Analyst will fetch the data as per requirement and store the output in MONGODB.

ENVIRONMENT: Apache hadoop 2.7.1 with Mongo DB 3.2.3, Platform is Ubuntu, mongo-hadoop-1.5 connector

Could you please let me know how to set up the Hadoop yarn and MongoDB setup in the 3 node cluster

[Wan Bachtiar]

Could you please let me know how to set up the Hadoop yarn and MongoDB setup in the 3 node cluster

Hi Bibhu,

For integration with MongoDB, as a start you could check out:

• MongoDB: getting started with hadoop.
• MongoDB Connector for Hadoop.
• Hadoop and MongoDB Use Cases.

See Apache Hadoop Cluster Setup to install and configure Hadoop clusters from a few nodes to extremely large clusters with thousands of nodes. Though you would probably want to start with single node cluster setup to get familiar with the setup, test, etc.

Also you may find Cloudera: how to create a simple hadoop cluster with virtualbox useful.

For questions related to the hadoop installation and setup, you may get faster responses and wider audience by posting a question on StackOverflow: hadoop.

Kind regards,

Wan.

​

[bibhu patnaik]

Thank you so much Wan

Regards

Bibhu