Running Kamanja on 2 nodes

[Haitham Bjanthala]

Hello,

we did a test run for COPS models with our dataGenerationTool, the run was for 7 continuous days.

we used Kamanja-1.1.8 , and it was installed on 2 nodes .

however , after the run finished we discovered that one of the nodes was never utilized. any ideas on how to fix or find out what the issue is ?

--

Regards,

Haitham

[Saaim Aslam]

Was it similar data generated incrementally over the number of days or each message was unique?

--
You received this message because you are subscribed to the Google Groups "kamanja" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kamanja+u...@ligadata.com.
To post to this group, send email to kam...@ligadata.com.
Visit this group at https://groups.google.com/a/ligadata.com/group/kamanja/.

[Sridhar Andapally]

It depends on number of partitions that were used for kafka input topic.

Make sure you have more than one partition and also the make sure test data has more than one for user id.

Thanks,

Sridhar

[Koushik]

Did you partition the input queue?

Thanks,

Koushik

[Haitham Bjanthala]

inside the CreateQueues.sh file i found this:

.....

$KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper 172.30.2.55:2181 --replication-factor 1 --partitions 6 --topic c_input

$KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper 172.30.2.55:2181 --replication-factor 1 --partitions 6 --topic c_output

.....

i think it means it has 6 partitions.

could it be a configuration issue ? where should i look for such thing?

On Wed, Jan 6, 2016 at 6:24 PM, Koushik <kulka...@gmail.com> wrote:

Did you partition the input queue?

Thanks,

Koushik

-------- Original message --------
From: Saaim Aslam <sa...@ligadata.com>
Date: 06/01/2016 21:28 (GMT+05:30)
To: Haitham Bjanthala <hai...@ligadata.com>
Cc: kamanja <kam...@ligadata.com>
Subject: Re: Running Kamanja on 2 nodes

Was it similar data generated incrementally over the number of days or each message was unique?

On Jan 6, 2016 9:55 AM, "Haitham Bjanthala" <hai...@ligadata.com> wrote:

Hello,

we did a test run for COPS models with our dataGenerationTool, the run was for 7 continuous days.

we used Kamanja-1.1.8 , and it was installed on 2 nodes .

however , after the run finished we discovered that one of the nodes was never utilized. any ideas on how to fix or find out what the issue is ?

--

Regards,

Haitham

--
You received this message because you are subscribed to the Google Groups "kamanja" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kamanja+unsubscribe@ligadata.com.

To post to this group, send email to kam...@ligadata.com.
Visit this group at https://groups.google.com/a/ligadata.com/group/kamanja/.

--
You received this message because you are subscribed to the Google Groups "kamanja" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kamanja+unsubscribe@ligadata.com.

To post to this group, send email to kam...@ligadata.com.
Visit this group at https://groups.google.com/a/ligadata.com/group/kamanja/.

--

Regards,

Haitham

[Ahmed Abudayyah]

Haitham,

Make sure that you run CreatQueue.sh script before starting the cluster .


Sent from my Windows Phone

---

From: Haitham Bjanthala
Sent: ‎1/‎6/‎2016 11:22 PM
To: Koushik
Cc: Saaim Aslam; kamanja