No output when running PageRank example
15 views
Skip to first unread message
haijie
May 28, 2016, 5:35:40 AM5/28/16
to stanfordgpsusers
Hi, I try to run PageRank example according to the documentation, https://sites.google.com/site/gpsdocumentation/home/how-to-program-and-run-gps.
test_machine_config.cfg:
-1 gps01 4198
0 gps02 4199
1 gps03 4200
2 gps04 4201
3 gps05 4202
ubuntu@gps01:~/trunk/master-scripts$ ./start_gps_nodes.sh 4 quick-start \
> "-ifs /data/soc-Epinions1-d-n.txt \
> -hcf /usr/local/hadoop/conf/core-site.xml \
> -jc gps.examples.pagerank.PageRankVertex###JobConfiguration \
> -mcfg /machine-configs/test_machine_config.cfg \
> -log4jconfig /home/ubuntu/trunk/conf/log4j.config \
> -other -max###40"
master GPS_DIR=/home/ubuntu/trunk
starting gps master locally
1: /home/ubuntu/trunk/scripts
2: -1
3: 4
4: quick-start
ubuntu
starting gps worker /home/ubuntu/trunk/scripts
-Xincgc -Xms50M -Xmx50M
./start_gps_node.sh: line 30: /home/ubuntu/var/tmp/quick-start-machine-1-output. txt: No such file or directory
1 gps02 4
ssh gps02 "/home/ubuntu/trunk/scripts/start_gps_node.sh 4 quick-start \"-ifs / data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.exa mples.pagerank.PageRankVertex###JobConfiguration -mcfg /machine-configs/test_mac hine_config.cfg -log4jconfig /home/ubuntu/trunk/conf/log4j.config -other -max### 40\""running command: ssh gps02 /home/ubuntu/trunk/scripts/start_gps_node.sh /h ome/ubuntu/trunk/scripts 0 4 quick-start "-ifs /data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.examples.pagerank.PageRankVertex### JobConfiguration -mcfg /machine-configs/test_machine_config.cfg -log4jconfig /ho me/ubuntu/trunk/conf/log4j.config -other -max###40"
1: /home/ubuntu/trunk/scripts
2: 0
3: 4
4: quick-start
ubuntu
starting gps worker /home/ubuntu/trunk/scripts
-Xincgc -Xms256M -Xmx256M
2 gps03 4
ssh gps03 "/home/ubuntu/trunk/scripts/start_gps_node.sh 4 quick-start \"-ifs / data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.exa mples.pagerank.PageRankVertex###JobConfiguration -mcfg /machine-configs/test_mac hine_config.cfg -log4jconfig /home/ubuntu/trunk/conf/log4j.config -other -max### 40\""running command: ssh gps03 /home/ubuntu/trunk/scripts/start_gps_node.sh /h ome/ubuntu/trunk/scripts 1 4 quick-start "-ifs /data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.examples.pagerank.PageRankVertex### JobConfiguration -mcfg /machine-configs/test_machine_config.cfg -log4jconfig /ho me/ubuntu/trunk/conf/log4j.config -other -max###40"
1: /home/ubuntu/trunk/scripts
2: 1
3: 4
4: quick-start
ubuntu
starting gps worker /home/ubuntu/trunk/scripts
-Xincgc -Xms256M -Xmx256M
3 gps04 4
ssh gps04 "/home/ubuntu/trunk/scripts/start_gps_node.sh 4 quick-start \"-ifs / data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.exa mples.pagerank.PageRankVertex###JobConfiguration -mcfg /machine-configs/test_mac hine_config.cfg -log4jconfig /home/ubuntu/trunk/conf/log4j.config -other -max### 40\""running command: ssh gps04 /home/ubuntu/trunk/scripts/start_gps_node.sh /h ome/ubuntu/trunk/scripts 2 4 quick-start "-ifs /data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.examples.pagerank.PageRankVertex### JobConfiguration -mcfg /machine-configs/test_machine_config.cfg -log4jconfig /ho me/ubuntu/trunk/conf/log4j.config -other -max###40"
1: /home/ubuntu/trunk/scripts
2: 2
3: 4
4: quick-start
ubuntu
starting gps worker /home/ubuntu/trunk/scripts
-Xincgc -Xms256M -Xmx256M
4 gps05 4
ssh gps05 "/home/ubuntu/trunk/scripts/start_gps_node.sh 4 quick-start \"-ifs / data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.exa mples.pagerank.PageRankVertex###JobConfiguration -mcfg /machine-configs/test_mac hine_config.cfg -log4jconfig /home/ubuntu/trunk/conf/log4j.config -other -max### 40\""running command: ssh gps05 /home/ubuntu/trunk/scripts/start_gps_node.sh /h ome/ubuntu/trunk/scripts 3 4 quick-start "-ifs /data/soc-Epinions1-d-n.txt -hcf /usr/local/hadoop/conf/core-site.xml -jc gps.examples.pagerank.PageRankVertex### JobConfiguration -mcfg /machine-configs/test_machine_config.cfg -log4jconfig /ho me/ubuntu/trunk/conf/log4j.config -other -max###40"
1: /home/ubuntu/trunk/scripts
2: 3
3: 4
4: quick-start
ubuntu
Log file in a slave:
16/05/28 09:02:26 INFO node.GPSNodeRunner: Classpath: /home/ubuntu/trunk/gps_node_runner.jar
16/05/28 09:02:26 INFO node.GPSNodeRunner: ************************ Argument list ************************
16/05/28 09:02:26 INFO node.GPSNodeRunner: -Xincgc
16/05/28 09:02:26 INFO node.GPSNodeRunner: -Xms256M
16/05/28 09:02:26 INFO node.GPSNodeRunner: -Xmx256M
16/05/28 09:02:26 INFO node.GPSNodeRunner: -verbose:gc
16/05/28 09:02:26 INFO node.GPSNodeRunner: machineid:3
16/05/28 09:02:26 INFO node.GPSNodeRunner: outputfileprefix:/user/ubuntu/gps/output/quick-start-output-3-of-4
16/05/28 09:02:26 INFO node.GPSNodeRunner: inputfiles:/data/soc-Epinions1-d-n.txt
16/05/28 09:02:26 INFO node.GPSNodeRunner: hadoopconffiles:/usr/local/hadoop/conf/core-site.xml
16/05/28 09:02:26 INFO node.GPSNodeRunner: jc:gps.examples.pagerank.PageRankVertex###JobConfiguration
16/05/28 09:02:26 INFO node.GPSNodeRunner: machineconfigfile:/machine-configs/test_machine_config.cfg
16/05/28 09:02:26 INFO node.GPSNodeRunner: log4jconfig:/home/ubuntu/trunk/conf/log4j.config
16/05/28 09:02:26 INFO node.GPSNodeRunner: other:-max###40
16/05/28 09:02:26 INFO node.GPSNodeRunner: ************************ End of argument list ************************
16/05/28 09:02:26 INFO node.GPSNodeRunner: Launching GPSNodeRunner: Total memory: 259719168 Free memory: 255526864
123 [main] INFO gps.node.Utils - fs.hdfs.impl: org.apache.hadoop.hdfs.DistributedFileSystem
127 [main] INFO gps.node.Utils - fs.default.name: file:///
128 [main] INFO gps.node.Utils - adding conf file: /usr/local/hadoop/conf/core-site.xml
158 [main] INFO gps.node.Utils - fs.hdfs.impl: org.apache.hadoop.hdfs.DistributedFileSystem
158 [main] INFO gps.node.Utils - fs.default.name: hdfs://gps01:9000
708 [main] INFO gps.node.GPSNodeRunner - JC: gps.examples.pagerank.PageRankVertex###JobConfiguration
712 [main] INFO gps.node.GPSNodeRunner - GPSJobConfiguration: vertexFactoryClass: gps.examples.pagerank.PageRankVertex.PageRankVertexFactory
vertexClass: gps.examples.pagerank.PageRankVertex
masterClass: gps.graph.Master
vertexValueClass: gps.writable.DoubleWritable
messageValueClass: gps.writable.DoubleWritable
edgeValueClass: gps.writable.NullWritable
712 [main] INFO gps.node.GPSNodeRunner - Started GPSWorker...
otherOptsStr: -max###40
numMaxIterations: 40
716 [main] INFO gps.messages.storage.ArrayBackedIncomingMessageStorage - Data Structure Sizes: 101
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
otherOptsStr: -max###40
numMaxIterations: 40
Inside Static GPSWorkerImpl: true
823 [main] INFO gps.node.worker.StaticGPSWorkerImpl - Starting GPS Worker. localMachineId: 3
835 [Thread-2] INFO gps.communication.mina.ServerConnectionsEstablisher - Trying to bind to port: 4202
839 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 0
840 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
841 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
1208 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session CREATED: 1464397347766 machineId: null
1208 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session OPENED: machineId: null
1216 [NioProcessor-1] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - putSession: putting machineId: 2 machineIdAttribute: 2
1343 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 1
1344 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
1344 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
1344 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
1347 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session CREATED: 1464397347915 machineId: null
1347 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session OPENED: machineId: null
1358 [NioProcessor-1] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - putSession: putting machineId: 1 machineIdAttribute: 1
1811 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session CREATED: 1464397348378 machineId: null
1811 [NioProcessor-1] INFO gps.communication.mina.worker.MessageHandlerForWorker - session OPENED: machineId: null
1813 [NioProcessor-1] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - putSession: putting machineId: 0 machineIdAttribute: 0
1847 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
1848 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
1848 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
1848 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
1848 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
1848 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
2352 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
2855 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
2856 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
2856 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
2856 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
2856 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
2856 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
3359 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
3360 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
3360 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
3360 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
3360 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
3360 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
3864 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - sleeping for 500 millis. numEstablishedConnection: 3
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - Dumping established connections
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 0
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 1
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - 2
4368 [main] INFO gps.communication.mina.worker.MinaMessageSenderAndReceiverForWorker - End of dumping established connections
What happened?
Reply all
Reply to author
Forward
0 new messages