Please post questions here below

[Nitesh Jain]

Please feel free to start a discussion topic here below.

[vishal bhatt]

On Friday, May 23, 2014 10:43:57 AM UTC-4, Nitesh Jain wrote:

Please feel free to start a discussion topic here below.

Hortonworks hadoop 2.0 developer certification training

Hi Nitesh,

 

This is Vishal. I am very keen on giving Hortonworks hadoop 2.0 developer certification. Now, this certification explores the data analysis side of things and has nothing to with java based map reduce.It focuses on Pig,Hive,hcatalog  and tools like oozie.i am not even concerned about how to install these components. My major need is how they are used for analysis. I already know more then handful about these topics. but a training would do me a wolrd of good and help me prepare more effectively for the certification. So.my question to you is does your course content cater to the data analysis topics? I am NOT a developer so was wondering would enrolling in your course help me learn about the data analysis side of things?hope to hear back soon.

 

Regards,

Vishal

[Shiva Kumar]

Hi,
I could not able to browse courses in http://courses.hadoop-skills.com/ due to missing plugin in Ubuntu. Let me know anyways to install plugins

[Nitesh Jain]

Hey Shiva,

You would need to install flash to make play the videos on Linux system. Following is the link which would guide you through : http://www.wikihow.com/Install-Flash-Player-on-Ubuntu

Best,

Nitesh

[Nitesh Jain]

Hey Ankush,

Hope you are doing great!

I can surely help you with the project, but I am not sure if you are looking just for an idea or you have a project idea and need my help. Lets discuss this off on another thread and I would see how I can help you out in the best way possible.

Best,

Nitesh

On Tuesday, 8 July 2014 04:59:49 UTC+10, ANKUSH PATIL wrote:

Hey Nitesh Greetings:)

 

I am M.Tech Computer science engineering Student..

 

This course certainly would help me learn hadoop, No doubt in that!

 

Can you be Of any help to me For my Academic Project on  Hadoop?

 

i am greatly Intrested to Do my ACADEMIC Project on HADOOP.. but missing the link...

can u provide me some sources?

 

Atleast a sort of guidence?

 pls help me... 

[visu c]

Hi Nitesh , 

Would there be any documentation available with you for installing Hadoop in Mac , the tutorial covers only for windows.

On Friday, May 23, 2014 10:43:57 AM UTC-4, Nitesh Jain wrote:

[kintali saptagiri]

hi
 I am from Udemy. I am getting No such file or directory when i was trying to change directory as below

cd /usr/loca/java.  Though "java" directory exists. and "ls" command shows it

cd /usr/local ==> works successfully

then

cd /java ==> again fails with "no such file or directory"

same happening for "hadoop" directory also.

looks like it is happening for folders that i created in VB

please help me on how to resolve.

[Dinakar]

Saptagiri,

Please post exactly what are you planning to do to help you better. May be there is no "java" folder under "/usr/local" directory on your machine or the login you are using do not have privileges to view the folder. Are you looking for where Java is installed on your machine? 

You are using "cd /Java" from "/usr/local" directory. "/" is the root directory. I am not sure if it was a typo while posting this question, but just wanted to update you.

Please post your requirement in detail.

Regards,

Dinakar.

--
hadoop-skills.com
---
You received this message because you are subscribed to the Google Groups "Hadoop Learners from Hadoop-skills.com" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hadoop-learner-tutorial-tra...@googlegroups.com.
Visit this group at http://groups.google.com/group/hadoop-learner-tutorial-training-community.
To view this discussion on the web, visit https://groups.google.com/d/msgid/hadoop-learner-tutorial-training-community/404a368c-9161-409c-be9c-41864270d4ac%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ateet mishra]

Hi Nitesh

I would like to join the course "Hadoop Developer Certification Made Easy | Tutorial | Training", could you let me know when can we start the course next month and what is the time that you offer(Oct-2014).  I am in Germany and follow CET time.

Regards

Ateet Mishra

[manoj rana]

Hadoop Hosting cost and any good providers?

Hello, I was reading about Hadoop hosting cost and had hard time rectifying the best provider to host any type of hadoop application. any idea?

On Friday, 23 May 2014 10:43:57 UTC-4, Nitesh Jain wrote:

[ahmed mohiuddin]

Hi,

Can you please answer the last two question that you mentioned in MapReduce Combiner recap video. Thanks

[shailendra acharya]

hello this is shailendra i m trying to install hadoop but stucking in format namenode plz see it what's wrong 

shail@shail:~/hadoop-0.20.2-cdh3u5$ bin/hadoop namenode –format

15/01/02 23:48:01 INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting NameNode

STARTUP_MSG:   host = shail/127.0.1.1

STARTUP_MSG:   args = [–format]

STARTUP_MSG:   version = 0.20.2-cdh3u5

STARTUP_MSG:   build = git://ubuntu-slave02/var/lib/jenkins/workspace/CDH3u5-Full-RC/build/cdh3/hadoop20/0.20.2-cdh3u5/source -r 30233064aaf5f2492bc687d61d72956876102109; compiled by 'jenkins' on Fri Oct  5 17:21:34 PDT 2012

************************************************************/

Usage: java NameNode [-format] | [-upgrade] | [-rollback] | [-finalize] | [-importCheckpoint] | [-recover [ -force ] ]

15/01/02 23:48:01 INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down NameNode at shail/127.0.1.1

************************************************************/

[vinay Kumar]

Hi Nitesh,

Thank you so much for your video's. I got some confidence back after the clarity you provided on Hadoop architecture.

I need some career path suggestion from you.

I worked on SQL related application and am good at SQL. Before I found your courses one of the Hadoop instructor mentioned that I need to be strong in Java order to sustain in Hadoop technologies.

Could you please help me to know how much I need to know about Java programming to work in Hadoop. Also, are there any other paths with in Hadoop which doesnt need much of the programming skills .

Will wait for your valuable inputs and suggestions.

Regards

Vinay

[harika goud]

Hi,
I am Harika, I bought Hadoop Videos at " http://www.hadooponlinetutor.com/hadoop-5-for-1-offer
Its good. I learnt a lot. Along with hadoop videos they give Free JAVA (Core & Advanced) videos. It was very helpful to me.
Now I am planing to do hadoop certification. If any one knows where to do, please help me..

Thnaks & regards,
Harika

[spsan...@gmail.com]

spsan...@gmail.com

2:08 PM (1 hour ago)

I am trying to install Hadoop 2.6.0 on Ubuntu 14. I have download the file hadoop-2.6.0.tar.gz  from apache and followed the steps to unpacking it. I have java version 1.8 as seen below by the output of the command java -version in my terminal

java version "1.8.0_45"

Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)

I follow the path below:
cd /usr/lib/jvm

and type cd java* which brings up the following path:
/usr/lib/jvm/java-1.6.0-openjdk-amd64

Which seems odd since I have 1.8.0_45 installed ad that is the version that comes up. With this information I pasted the output of pwd into the .bashrc file and then restarted my terminal. When typing Hadoop -version I get the following output:
/usr/bin/hadoop: line 350: /usr/lib/jvm/java-6-sun/bin/java: No such file or directory
/usr/bin/hadoop: line 434: /usr/lib/jvm/java-6-sun/bin/java: No such file or directory

I do not know where to go from here.

Thank you,

On Friday, May 23, 2014 at 10:43:57 AM UTC-4, Nitesh Jain wrote:

[Kapil Sharma]

Hi All,

Q1. what are the different UDFs available in HIVE?

Q2. if you can please provide me the link or material for --> " how map-reduce works and what are its different stages?" 

Q3. what are the advantages over connecting HIVE+RDBMS via sqoop over connecting RDMS to HDFS and dump the data to HDFS and then process the data into HIVE.

Thanks

Kapil Sharma

[rumy hasan]

Hi Nitesh Jain
   
         I follow all the instruction as you say then when I give the cmd start-dfs.sh it show me this

     hduser@rumy:~$ start-dfs.sh
15/07/28 00:54:22 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
localhost]
sed: -e expression #1, char 6: unknown option to `s'
-c: Unknown cipher type 'cd'
Server: ssh: Could not resolve hostname server: Name or service not known
it: ssh: Could not resolve hostname it: No address associated with hostname
that: ssh: Could not resolve hostname that: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
will: ssh: Could not resolve hostname will: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
loaded: ssh: Could not resolve hostname loaded: Name or service not known
<libfile>',: ssh: Could not resolve hostname <libfile>',: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-bit: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
with: ssh: Could not resolve hostname with: Name or service not known
warning:: ssh: Could not resolve hostname warning:: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
OpenJDK: ssh: Could not resolve hostname openjdk: Name or service not known
link: ssh: Could not resolve hostname link: No address associated with hostname
'-z: ssh: Could not resolve hostname '-z: Name or service not known
with: ssh: Could not resolve hostname with: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
recommended: ssh: Could not resolve hostname recommended: Name or service not known
You: ssh: Could not resolve hostname you: Name or service not known
guard: ssh: Could not resolve hostname guard: Name or service not known
The: ssh: Could not resolve hostname the: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not known
to: ssh: connect to host to port 22: Connection refused
VM: ssh: Could not resolve hostname vm: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
might: ssh: Could not resolve hostname might: Name or service not known
try: ssh: Could not resolve hostname try: Name or service not known
VM: ssh: Could not resolve hostname vm: Name or service not known
It's: ssh: Could not resolve hostname it's: Name or service not known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known
disabled: ssh: Could not resolve hostname disabled: Name or service not known
now.: ssh: Could not resolve hostname now.: Name or service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
you: ssh: Could not resolve hostname you: Name or service not known
localhost: namenode running as process 4012. Stop it first.
localhost: datanode running as process 4238. Stop it first.
Starting secondary namenodes [OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
0.0.0.0]
sed: -e expression #1, char 6: unknown option to `s'
-c: Unknown cipher type 'cd'
fix: ssh: Could not resolve hostname fix: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
VM: ssh: Could not resolve hostname vm: Name or service not known
loaded: ssh: Could not resolve hostname loaded: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
The: ssh: Could not resolve hostname the: Name or service not known
VM: ssh: Could not resolve hostname vm: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
guard: ssh: Could not resolve hostname guard: Name or service not known
that: ssh: Could not resolve hostname that: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not known
with: ssh: Could not resolve hostname with: Name or service not known
recommended: ssh: Could not resolve hostname recommended: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
OpenJDK: ssh: Could not resolve hostname openjdk: Name or service not known
will: ssh: Could not resolve hostname will: Name or service not known
might: ssh: Could not resolve hostname might: Name or service not known
you: ssh: Could not resolve hostname you: Name or service not known
Server: ssh: Could not resolve hostname server: Name or service not known
disabled: ssh: Could not resolve hostname disabled: Name or service not known
now.: ssh: Could not resolve hostname now.: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-bit: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
You: ssh: Could not resolve hostname you: Name or service not known
try: ssh: Could not resolve hostname try: Name or service not known
The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established.
ECDSA key fingerprint is 45:c1:f4:76:63:bd:50:91:90:62:5a:00:c3:75:b6:7e.
Are you sure you want to continue connecting (yes/no)? to: ssh: connect to host to port 22: Connection refused
with: ssh: Could not resolve hostname with: Name or service not known
<libfile>',: ssh: Could not resolve hostname <libfile>',: Name or service not known
it: ssh: Could not resolve hostname it: No address associated with hostname
warning:: ssh: Could not resolve hostname warning:: Name or service not known
'-z: ssh: Could not resolve hostname '-z: Name or service not known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name or service not known
link: ssh: Could not resolve hostname link: No address associated with hostname
It's: ssh: Could not resolve hostname it's: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known


note: In my installation process I don't use VMbox.I install ubuntu on my pc then follow the instruction.

It's make me happy that you ans me.Thanks

[Abhishek Srivastava]

Hello,

    How can we fetch data in size of TB for analysis using hadoop tools?

Thanks.

[Aj]

Hello,

Please look into this ASAP. I am not able to access any type of quiz & not even the Final Quizzes

[Ateet mishra]

hello all

Looks like the link is broken 

cant access -->  http://courses.hadoop-skills.com/course/hadoop-tutorial-training-certification/

Is that same for all.....

On Sun, Sep 27, 2015 at 10:47 PM, Aj <aijazm...@gmail.com> wrote:

Hello,

Please look into this ASAP. I am not able to access any type of quiz & not even the Final Quizzes

--
hadoop-skills.com
---
You received this message because you are subscribed to a topic in the Google Groups "Hadoop Learners from Hadoop-skills.com" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/hadoop-learner-tutorial-training-community/_pXlEmRs-gE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to hadoop-learner-tutorial-tra...@googlegroups.com.

Visit this group at http://groups.google.com/group/hadoop-learner-tutorial-training-community.

To view this discussion on the web, visit https://groups.google.com/d/msgid/hadoop-learner-tutorial-training-community/32bed35d-d14f-48d4-814a-d843ff80269f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks
Ateet Mishra

[nitin...@webners.com]

Hi,

  I have install hadoop, hive and language R in my system sucessfully. But i want make connection R with hadoop. so please help me out. 

[singhalk...@gmail.com]

Hi Nitesh

Your basics course is really good. You very well cover and present the ground realities. Thanks for sharing across!

I am more interested in something advanced concept wise that can cover the deeper details of Hadoop Ecosystem including Spark. like how DAG approached changed the things in recent releases etc. Also i want to head towards Data Science a bit.. as you mentioned that there is good overlap between the Data Enginner and Scientist. Do you have some course for it or if you can please guide me to something else.

Thanks

Keshav Singhal

[Balasubramanian Kirahamdurai]

NOT ABLE TO VIEW MY HADOOP COURSE

I SENT AN EMAIL TO hadoop...@gmail.com

[Yahya Najjar]

Hello..

I have very basic question on hadoop, 

1.   $ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar grep input output 'dfs[a-z.]+'
   

taking the above example, if he input file is located on one of the slave nodes, how should I set the path ?

[alizade...@gmail.com]

DataNode not running on Hadoop 2.6.3

down votefavorite

i have a windows 8.1 on my laptop, a VMware on it and 2 ubuntu 14.04 as guests. Im trying to install a multi node Hadoop 2.6.3 on them. one VM as HadoopMaster and the other HadoopSlave1. i took the steps in below link to set up a single node Hadoop:http://www.bogotobogo.com/Hadoop/BigData_hadoop_Install_on_ubuntu_single_node_cluster.php then i started to turn it to a multi node Hadoop, doing the steps in this link: http://pingax.com/install-apache-hadoop-ubuntu-cluster-setup/ everything went OK exactly like was told in the toturial,except in the last step when i fire jps command on HadoopSlave1 i see no datanode. i googled a lot and checked everything,and made sure there is no problem in /etc/hosts. i did stop-dfs.sh and stop-yarn.sh and then fired start-dfs.sh and start-yarn.sh still no change. i formatted the namenode by hadoop namenode -format command and no change again. and there is no connectivity problem. ping and SSH are working correctly. any idea why i cant get DataNode running on my slave???

[Pram M]

I have enrolled for the online training but non of the quiz load. Please investigate. Otherwise please add the quiz on static page.

[Tai Kuti]

How much space is enough for 64 -bits VMbox I have trouble allocating the right memory size?

[Daniel Raiche]

My courses don't work anymore. The quiz's have been non functional for the last year. Is that going to get fixed? Should I ask for a refund? I noticed that it's really hard to do, actually there's no where to request a refund even though it says your supposed to be 100% satisfied. I can't even finish the course material. There are other courses that work that I have taken in place of this one now. 

There are questions about non-functioning quiz's all over the forums and no solution. Why hasn't this been addressed, it's a back end issue, obviously.

"Network Error (tcp_error)

A communication error occurred: "Operation timed out"

The Web Server may be down, too busy, or experiencing other problems preventing it from responding to requests. You may wish to try again at a later time.

For assistance, contact your network support team."

[Anshul Udapure]

Hi Nitesh

http://ec2-52-35-122-71.us-west-2.compute.amazonaws.com:50070/webhdfs/v1/user/ubuntu/training/file2/part-r-00000?op=LISTSTATUS

it give output 

{"FileStatuses":{"FileStatus":[
{"accessTime":1457408551025,"blockSize":67108864,"group":"supergroup","length":16,"modificationTime":1457336753406,"owner":"ubuntu","pathSuffix":"","permission":"666","replication":2,"type":"FILE"}
]}}

I want to read same file

http://ec2-52-35-122-71.us-west-2.compute.amazonaws.com:50070/webhdfs/v1/user/ubuntu/training/file2/part-r-00000?op=OPEN

IT is not giving output. what should I do .what is correct url to get output.?

Thanks

[Tushar Chokshi]

Hadoop 2.x installation problems with 64bit Java

I am trying to install hadoop-2.4.1.

I followed all instructions given on 'http://www.tutorialspoint.com/hive/hive_installation.htm' to configure it. I am able to start hadoop using 'start-all.sh' also.

But when I try to access hdfs using 'hadoop fs -ls /' command, I am getting below Warning.

16/03/31 21:46:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

I searched many forums. They are saying that hadoop code is built using java 32 bit and I have installed java 8 64 bit. So, hadoop source code needs to be rebuit and its native library needs to be replaced. To do that, they are asking to install many libraries like cmake,protobuf,g++,maven and ant. I installed all of them and then downloaded hadoop-2.4.1-src and tried to package it using maven command 'mvn clean package -Pdist,native -Dtar -Dmaven.javadoc.skip=true -DskipTests', but failing with below error

[ERROR] Failed to execute goal org.codehaus.mojo:native-maven-plugin:1.0-alpha-8:javah (default) on project hadoop-common: Error running javah command: Error executing command line. Exit code:127 -> [Help 1]

I looked into many forums, they are saying to change hadoop-common's pom.xml to change the scope of 'hadoop-annotations' dependency as 'provided' instead of 'compile'.

I tried that too, but error remains same.

I am not able to proceed. I would appreciate, if you can help me. 

[Melbi Mathew]

On Friday, May 23, 2014 at 8:13:57 PM UTC+5:30, Nitesh Jain wrote:

Please feel free to start a discussion topic here below.

Hi Nitesh,

I am interested in taking up a Hadoop course. I checked the course curriculum in the website and found it unclear. The videos seemed small i.e for around 5 mins each. Is the course not a detailed one?

I am totally a beginner into Hadoop and wanted a in depth course. Can you clarify how this course will help me?

Regards,

Melbi Mathew 

[DAN]

HELLO EVERY ONE

IM WORKING ON A CODE THAT PERMIT TO DEVELOP THE COMMAND GREP (IN JAVA) ON A WAY TO MAKE IT SEARCH FOR CERTAIN WORDS 

IN MANY TEXTS INSTEAD JUST ONE  BY USING HADOOP (BECAUSE TEXTS WILL BE IN A DISTRIBUTED SYSTEM ) 

ANY ONE HAS ANY IDEA HOW TO DEVELOP THE GREP COMMAND TO MAKE IT WORK ON MANY TEXTS USING HADOOP

REGARDS

[Neetu Sharma]

Hi,

Pls let me know how can i transfer file .jar file from PC to Oracle VMware, I want to run my first MapReduce program but unabel to do so. Pls suggest me the way to copy the file .

On Friday, May 23, 2014 at 7:43:57 AM UTC-7, Nitesh Jain wrote:

[Sudheer Yadav]

Hi, 

We are planning to Apache Hadoop on AWS cloud ec2 instance , And we are working through auto scalling option provided by AWS, But the question here is in case of scaling up of nodes in hadoop is pretty straight forward and  when it come to scaling down we see a challenge were me may loose the data which was the node which are going to decommission as part of scaling down , Can you please help us with a better option how this can be achieved ?  

[Raj Sharma]

Hi All,

I have a doubt in Hadoop related to interoperability.

Can a single zookeeper interact with both Solr and Hbase system ? If yes how is it going to interact. 

Also

Let us consider we have a zookeeper which is interacting with both a Solr system as well as a Hbase system.

The requirement for Solr and Hbase system are different.

How is the zookeeper going to differentiate between the requirements of Solr and Hbase system

[ROHIT MITTAL]

hello sir,

i am facing a little problem in dealing with Json data ,

i am loading my data with 

A = load '/dir_name/file.json' using JsonLoader(schema)

but when dump A;

it gives output as (, , , , , ) as many times the data is .

please look at the screenshot attached.

[Rishabh Jain]

hello Can i still redeem coupoun code vip90 i am really excited to do this course but facing financial problems .

[Saranya Srinivasan]

Hi Nitesh, I have started the course today and after one video it is getting redirected to some other website where i cannot access next sessions any more. Same thing in my tablet , laptop. Can you please have the technical team get this fixed as soon as possible.

Getting redirected this website - http://ww2.quizzlr.com/?folio=7POYGN0G2

Regards,

Saran

[Chetan Goyal]

Hi Nitesh,

Can you help in Hadoop Admin certification from Cloudera

Please let me know if possible

Thanks

[sharad gupta]

hi

plz use "WINSCP" for transferring file from PC to VMware.

[Viral Patel]

Hi Nitesh,

The Hadoop-skills.com website is down and I am not able to access the website.

Can you let us know when will it be up and running.

Viral Patel

[Gokul Vijay]

Hi ,

I am running a sample job(Word Count) in a Cygwin 64 bit terminal with hadoop 1.0.4. I am able to submit a job but the problem is Hadoop cannot process the job, throws the following in the console

$ bin/hadoop jar hadoop-examples-1.0.4.jar wordcount input output

16/11/02 12:29:25 INFO input.FileInputFormat: Total input paths to process : 1

16/11/02 12:29:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

16/11/02 12:29:25 WARN snappy.LoadSnappy: Snappy native library not loaded

16/11/02 12:29:25 INFO mapred.JobClient: Running job: job_201611021225_0001

16/11/02 12:29:26 INFO mapred.JobClient:  map 0% reduce 0%

Note:No further process. Left the system idle for an hour

Please help me to make the job run

Regards,

Gokul

[Rajendra Ongole]

On Friday, May 23, 2014 at 8:13:57 PM UTC+5:30, Nitesh Jain wrote:

Please feel free to start a discussion topic here below.

Hi Nitesh- My Name Rajendra. i have purchased Hadoop Tutorial training program and i have completed 99% of the course. as we have at last three final quiz set ups. in that i am able to complete first two and i am not able to get the last one final quiz setip.

Kindly help me to provide the certification acknowledge on this from your Hadoop learning.

Regards,

Rajendra 

Ph:8939681348

[Anbu Eswaran]

Hi,

My name is Anbeswaran,

I have one scenario, which i described below, Please help me.

Is it possible to create a new tables with update of bash tables by using the below base tables and conditions. if yes please help me to create.

my input tables are below

delivery:

delivery_id count_reqd  order_date        prod_id    qty_delivered  
    1           30    2016-05-12 10:10:10    101            25
    2           40    2016-05-12 10:10:10    101            0
    3           20    2016-05-13 10:10:10    102            0

product:

prod_id prod_name   date_mfgd            qty_mgfd 
101     margo       2016-05-11 10:10:10      0
101     margo       2016-05-12 10:10:10     20
102     Tide        2016-05-13 10:10:10     20

inventory:

 prod_id          qty_available 
  101                 20
  102                 30

the above 3 tables are base tables. we wont update anything in that. we will create a new tables as delivery_dup, product_dup, inventory_dup and update below changes

1. in delivery table, count_reqd = 30 and qty_delivered = 25 so remaining 5.

2.this remaining 5 need to be reduce from product table based on prod_id if order_date>=date_mfgd. (here qty_mgfd is 0 in product table then goto the next record if prod_id is same).

3. means remaining 5 will reduce from 2nd record of product table if order_date>=date_mfgd (20-5). now qty_mgfd =15.

4.now qty_delivered= 25+5=30 so count_reqd=qty_delivered.

5. now goto the 2nd record of delivery table, count_reqd = 40 and qty_delivered = 0 so remaining 40.

6.latest qty_mgfd =15. so 40-15=25 so remaining =25 and 15 need to be reduce from product table based on prod_id if order_date>=date_mfgd. so qty_mgfd is 0 in product table

7.qty_delivered=15 now in delivery table.

8.so count_reqd != qty_delivered and qty is not available in product table

9 so now will go to the inv table check if prod_id is same then reduce remaining - qty_available (means 25-20 = remaining 5 now)

10.qty_delivered=15+20 = 35 now in delivery table.

I trust have explained my question clearly.

Thanks in advance, Anbu k

[Sreeram Vijay Maddury]

I am new to Hadoop and setting up my system for bigdata training. it is a single node setup.

I completed most of the tasks and stuck with an unresolved situation. I have set up environment variables including java home in both .bashrc and hadoop.env.sh (Path provided)

While formatting my namenode for HDFS, the following error is being seen and I am unable find where the problem is. Copying the details here

[sreeram@localhost ~]$ /home/sreeram/hadoop/bin/hdfs namenode -format

/home/sreeram/hadoop/bin/hdfs: line 305: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.141-2.6.10.1.el7_3.x86_64/bin/java: No such file or directory

The first line is a command and second line is error. with no such file or directory. The file is available in the directory. Java is properly setup. I find the same problem even with 1.80 java. I have taken the path of java through the command

update-alternatives --config java

I felt it is purely path problem. and checked both the file. It says line no 305, I do not find any configuration file having 305th line with Java_home

I need some help in resolving and stuck on this for the last 2 days

Thanks for the help in advance

Sreeram

[Adam lee]

The Best place to start your career in Big data Training In bangalore is besant technologies, they provide 100% placement assurance.

[raj kumar]

Hi,

I want to learn Hadoop Online Course 

P;x do suggest for better training centre so that I can learn easily and in a better way

Thank you ...