Re: how to decide no of operator partitions

4 views
Skip to first unread message

Amol Kekre

unread,
May 8, 2017, 12:02:36 AM5/8/17
to us...@apex.apache.org, DataTorrent Users Group

Rishi,
How much time elapses between old app and new app? It may an issue of resource needs to catch up. Have  you benchmarked your operators/app? 

Thks
Amol



On Sun, May 7, 2017 at 11:02 AM, rishi <rishi....@target.com> wrote:
Hi,

I am running one of the apex application which contains multiple operators.
For some operators I assigned >1 partitions as it has to do some heavy
lifting compared to other operators. Like kafka operator I have given 2
partitions.

Now thing is I restarted the running application which got killed after 2-3
days and after that I see there is huge latency in some of the
operators.Even after 2-3 days latency no is huge and application is not able
to process today's record.

So please suggest me how to handle this kind of scenario. when we restart
application and if we see huge latency no.

Thanks
Rishi






--
View this message in context: http://apache-apex-users-list.78494.x6.nabble.com/how-to-decide-no-of-operator-partitions-tp1580.html
Sent from the Apache Apex Users list mailing list archive at Nabble.com.

Reply all
Reply to author
Forward
0 new messages