GPS example not working: java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName

[Satyanarayana Vusirikala]

Hi all,

Recently I installed GPS by following its documentation. I was trying to run the example provided in the documentation, but am facing some errors.

I am attaching screenshot of my run. I am having one slave node and one master node. I copied hadoop-common-2.7.1.jar from /usr/local/hadoop/share/hadoop/common/.

Here is my log file in /var/tmp/quick-start-machine-1-output.txt

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - Classpath: /usr/local/trunk/gps_node_runner.jar

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - ************************ Argument list ************************

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - -Xincgc

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - -Xms50M

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - -Xmx50M

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - -verbose:gc

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - machineid:-1

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - outputfileprefix:/user/root/gps/output/quick-start-machine-stats

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - inputfiles:/data/soc-Epinions1-d-n.txt

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - hadoopconffiles:/usr/local/hadoop/etc/hadoop/core-site.xml

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - jc:gps.examples.pagerank.PageRankVertex###JobConfiguration

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - machineconfigfile:/machine-configs/test_machine_config.cfg

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - log4jconfig:/usr/local/trunk/conf/log4j.config

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - other:-max###40

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - ************************ End of argument list ************************

[11:51:08] main INFO  [] [] [gps.node.GPSNodeRunner] - Launching GPSNodeRunner: Total memory: 50724864 Free memory: 47632392

630  [main] INFO  gps.node.Utils  - fs.hdfs.impl: null

631  [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - fs.default.name is deprecated. Instead, use fs.defaultFS

632  [main] INFO  gps.node.Utils  - fs.default.name: file:///

632  [main] INFO  gps.node.Utils  - adding conf file: /usr/local/hadoop/etc/hadoop/core-site.xml

787  [main] INFO  gps.node.Utils  - fs.hdfs.impl: null

787  [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - fs.default.name is deprecated. Instead, use fs.defaultFS

787  [main] INFO  gps.node.Utils  - fs.default.name: hdfs://localhost:9000

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName

at org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserGroupInformation.java:365)

at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:410)

at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2812)

at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2802)

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2668)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)

at gps.node.Utils.getFileSystem(Utils.java:62)

at gps.node.GPSNodeRunner.main(GPSNodeRunner.java:132)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName

at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

... 9 more

I will be greatly helpful if someone could help in this regard. I am also confused with the location of output file. Where will the output file be located? The documentation says  /user/$USER/gps/output/ is the output directory. Will this directory be automatically created in the hdfs?

Thanks a lot in advance.