please help .. kmean execution problem

[Sonam Gupta]

sonam_@ubuntu:~/Downloads/twister-0.9/samples/kmeans/bin$ ./run_kmeans.sh /home/sonam_/Downloads/twister-0.9/samples/kmeans/bin/init_cluster.txt 8 /home/sonam_/Downloads/twister-0.9/samples/kmeans/bin/kmeans.pf
JobID: kmeans-map-reduceecdad837-7cca-11e3-b7a2-0d511197beee
Jan 13, 2014 7:21:15 PM org.apache.activemq.transport.failover.FailoverTransport doReconnect
INFO: Successfully connected to tcp://127.0.0.1:61616
1    [main] INFO  cgl.imr.client.TwisterDriver  - Desert Daemon 0
6    [main] INFO  cgl.imr.client.TwisterDriver  - Configure Mappers through the partition file, please wait....
cgl.imr.base.TwisterException: cgl.imr.data.DataPartitionException: Number of maps should be equal to the number of data partions.
    at cgl.imr.client.TwisterDriver.configureMapsInternal(TwisterDriver.java:636)
    at cgl.imr.client.TwisterDriver.configureMaps(TwisterDriver.java:644)
    at cgl.imr.samples.kmeans.KmeansClustering.driveMapReduce(KmeansClustering.java:154)
    at cgl.imr.samples.kmeans.KmeansClustering.main(KmeansClustering.java:123)
Caused by: cgl.imr.data.DataPartitionException: Number of maps should be equal to the number of data partions.
    at cgl.imr.client.TwisterDriver.configureMapsInternal(TwisterDriver.java:551)
    ... 3 more
11   [Thread-0] ERROR cgl.imr.client.TwisterDriver  - TwisterDriver failed. Removing the broker connection.
20   [Thread-0] DEBUG cgl.imr.client.ShutdownHook  - Shutting down complet

[Bingjing Zhang]

Number of maps should be equal to the number of data partions

--
You received this message because you are subscribed to the Google Groups "Twister Discussion Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to twister-discussion...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Bingjing Zhang 

张冰晶

[Sonam Gupta]

How to get number of data partition..which is equal to the number of map task

--
You received this message because you are subscribed to a topic in the Google Groups "Twister Discussion Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/twister-discussion-group/M3l_q0RO-EE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to twister-discussion...@googlegroups.com.

[Bingjing Zhang]

the number of partitions is the number of data files you split

[Sonam Gupta]

I am taking same example.. but error occurs..

[Bingjing Zhang]

how many files in kmeans.pf?

[Sonam Gupta]

kmeans.pf is empty

[Bingjing Zhang]

that means you didn't generate partition file correctly. 

[Sonam Gupta]

Why partition file is not generated correctly??

./twister.sh mkdir kmeans 

I am generating this directory but this directory is not there in data_dir ..

[Bingjing Zhang]

you need to do initdir first

create partition file through ./create_partition_file.sh

[Sonam Gupta]

 ./create_partition_file.sh kmeans kmeans_ $TWISTER_HOME/samples/kmeans/bin/kmeans.pf

yes .. i did same thing ..

kmeans.pf is generated but size of this file is 0 bytes..

[Bingjing Zhang]

did you put files in "kmeans" directory?

[Sonam Gupta]

./twister.sh initdir /home/sonam_/Downloads/twister-0.9/data

i create data directory .. but this is not there ..

then after i did
./twister.sh mkdir kmeans

kmeans directory is not there ..

What's the problem ..i am not getting..

Is is SSH problem or any other??

[Sonam Gupta]

./twister.sh initdir /home/sonam_/Downloads/twister-0.9/data

this data directory is visible or not??

[Bingjing Zhang]

please check twister.properties to check where you set your common directory.