On what concept the Hadoop framework works ? - Techdata solution

12 views
Skip to first unread message

sowmya trainer

unread,
Mar 7, 2016, 1:33:55 AM3/7/16
to Hadoop Learners from Hadoop-skills.com

Hadoop Framework works on the following two core components-

1)HDFS – Hadoop Distributed File System is the java based file system for scalable and reliable storage of large datasets. Data in HDFS is stored in the form of blocks and it operates on the Master Slave Architecture.

2)Hadoop MapReduce-This is a java based programming paradigm of Hadoop framework that provides scalability across various Hadoop clusters. MapReduce distributes the workload into various tasks that can run in parallel. Hadoop jobs perform 2 separate tasks- job. The map job breaks down the data sets into key-value pairs or tuples. The reduce job then takes the output of the map job and combines the data tuples to into smaller set of tuples. The reduce job is always performed after the map job is executed.


Here is a visual that clearly explain the HDFS and Hadoop MapReduce Concepts-
please watch below link for more learning

Reply all
Reply to author
Forward
0 new messages