Twister Java exception... :(

20 views
Skip to first unread message

ffoe...@gmail.com

unread,
Jul 28, 2010, 6:36:57 PM7/28/10
to vscse-big-data-...@googlegroups.com
i'm trying this on my machine...everything else went find, but I'm stuck on the put command...

foertter@devubu:~/Development/Twister/bin$ ./twister.sh put $TWISTER_HOME/samples/kmeans/input kmeans
Exception in thread "main" cgl.imr.config.ConfigurationException: java.io.FileNotFoundException: $TWISTER_HOME/bin/nodes (No such file or directory)
at cgl.imr.script.FileDistributor.getListOfNodes(FileDistributor.java:115)
at cgl.imr.script.FileDistributor.main(FileDistributor.java:179)
Caused by: java.io.FileNotFoundException: $TWISTER_HOME/bin/nodes (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:137)
at java.io.FileReader.<init>(FileReader.java:72)
at cgl.imr.script.FileDistributor.getListOfNodes(FileDistributor.java:107)
... 1 more

Stephen TAK-LON WU

unread,
Jul 28, 2010, 6:53:21 PM7/28/10
to vscse-big-data-...@googlegroups.com
Hi,

this is due to the environment setting in $TWISTER_HOME/bin/twister.properties, the following three lines must use full path:

For example :

nodes_file = /N/u/train182/Twister/bin/nodes   -> where I think in your setting should be "$TWISTER_HOME/bin/nodes" which is not supported.
app_dir = /N/u/train182/Twister/apps
data_dir = /N/u/train182/Twister/data 

Best,
Stephen
--
Stephen Wu
Pervasive Technology Institute
Indiana University, Bloomington

ffoe...@gmail.com

unread,
Jul 29, 2010, 2:02:13 AM7/29/10
to vscse-big-data-...@googlegroups.com
indeed, didn't notice #!/bin/bash wasn't buried along with the disclaimer comments...boo!

why not generate that file with start_twister.sh?  afterall, the num of deamons/works must match, the $TWISTER_HOME var has already been set by the user, the bin/apps/data folders are default, and the port should work by default (or again, have user edit start_twister.sh).

It doesn't make any sense to set vars manually in that file imo when we're already exporting them... well, I just edited my start_twister.sh script and added this to the bottom:
I also edited the copyright.txt file to bash commented, not java/c++ commenting.

#####################################################
#                Create Configuration File #
#####################################################
copyright_file=$TWISTER_HOME/copyright.txt
config_file=twister.properties

cat $copyright_file>$config_file
echo -e "
daemons_per_node = $numDaemons
workers_per_daemon = $numWorkers
pubsub_broker = NaradaBrokering
daemon_port = 12500
nodes_file = $TWISTER_HOME/bin/nodes
app_dir = $TWISTER_HOME/apps
data_dir = $TWISTER_HOME/data
">>$config_file
Reply all
Reply to author
Forward
0 new messages