Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
BackgroundJob corrupts long queries?
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  6 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Anton Volokhov  
View profile  
 More options Jul 18 2012, 11:19 am
From: Anton Volokhov <a.v.volok...@gmail.com>
Date: Wed, 18 Jul 2012 08:19:58 -0700 (PDT)
Local: Wed, Jul 18 2012 11:19 am
Subject: BackgroundJob corrupts long queries?

Hi there!
I'm using mongodb 2.0.5 with java driver 2.7.3
Current configuration is two shards with three replicas each
Mongos is deployed locally.

When I run long query in Java (full scan on 3000000 documents, 2-3
kilobytes each) after about an hour the process fails with the exception
[2012-07-18 17:49:06,787] ERROR [main] { "$err" : "getMore: cursor didn't
exist on server, possible restart or timeout?" , "code" : 13127}
No hardweight ops performed inside iterating loop.

Here is mongos logs:
Wed Jul 18 17:49:05 [conn4] want cursor : 4809402721582786738
Wed Jul 18 17:49:05 [conn4] CursorCache::get id: 4809402721582786738
Wed Jul 18 17:49:06 [conn4]      hasMore: 1 sendMore: 1 cursorMore: 1
ntoreturn: 0 num: 526 wouldSendMoreIfHad: 1 id:4809402721582786738
totalSent: 1684483
Wed Jul 18 17:49:06 [conn4] Request::process ns: testdb.load msg id:2986
attempt: 0
Wed Jul 18 17:49:06 [conn4] want cursor : 4809402721582786738
Wed Jul 18 17:49:06 [conn4] CursorCache::get id: 4809402721582786738
Wed Jul 18 17:49:06 [conn4] creating new connection to:mongodb02:27017
Wed Jul 18 17:49:06 BackgroundJob starting: ConnectBG
Wed Jul 18 17:49:06 [conn4] connected connection!
Wed Jul 18 17:49:06 [conn4] scoped connection to mongodb02:27017 not being
returned to the pool
Wed Jul 18 17:49:06 [conn4] AssertionException while processing op type :
2005 to : testdb.load :: caused by :: 13127 getMore: cursor didn't exist on
server, possible restart or timeo
ut?
Wed Jul 18 17:49:07 [conn4] Socket recv() conn closed? 127.0.0.1:57229
Wed Jul 18 17:49:07 [conn4] SocketException: remote: 127.0.0.1:57229 error:
9001 socket exception [0] server [127.0.0.1:57229]
Wed Jul 18 17:49:07 [conn4] end connection 127.0.0.1:57229
Wed Jul 18 17:49:09 [Balancer] about to acquire distributed lock
'balancer/anton:27000:1342613385:1804289383:
  "when" : { "$date" : "Wed Jul 18 17:49:09 2012" },
Wed Jul 18 17:49:10 [Balancer] distributed lock
'balancer/anton:27000:1342613385:1804289383' acquired, ts :
5006bed5d7f351f313cd9658
Wed Jul 18 17:49:10 [Balancer] *** start balancing round

During query processing no background jobs except this one were started.
Common log output:
Wed Jul 18 17:49:04 [conn4] CursorCache::get id: 4809402721582786738
Wed Jul 18 17:49:04 [conn4]      hasMore: 1 sendMore: 1 cursorMore: 1
ntoreturn: 0 num: 539 wouldSendMoreIfHad: 1 id:4809402721582786738
totalSent: 1683451
Wed Jul 18 17:49:04 [conn4] Request::process ns: testdb.load msg id:2984
attempt: 0
Wed Jul 18 17:49:04 [conn4] want cursor : 4809402721582786738
Wed Jul 18 17:49:04 [conn4] CursorCache::get id: 4809402721582786738
Wed Jul 18 17:49:04 [ReplicaSetMonitorWatcher] checking replica set: rset01


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Brendan W. McAdams  
View profile  
 More options Jul 19 2012, 11:35 am
From: "Brendan W. McAdams" <bren...@10gen.com>
Date: Thu, 19 Jul 2012 08:35:11 -0700 (PDT)
Local: Thurs, Jul 19 2012 11:35 am
Subject: Re: BackgroundJob corrupts long queries?

By default a cursor will timeout after 10 minutes of inactivity.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Anton Volokhov  
View profile  
 More options Jul 19 2012, 4:36 pm
From: Anton Volokhov <a.v.volok...@gmail.com>
Date: Thu, 19 Jul 2012 13:36:54 -0700 (PDT)
Local: Thurs, Jul 19 2012 4:36 pm
Subject: Re: BackgroundJob corrupts long queries?

But as far as I can understand it is still active, cursor requested getmore
just a few seconds before the exception occurs.

четверг, 19 июля 2012 г., 19:35:11 UTC+4 пользователь Brendan W. McAdams
написал:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Anton Volokhov  
View profile   Translate to Translated (View Original)
 More options Jul 25 2012, 10:36 am
From: Anton Volokhov <a.v.volok...@gmail.com>
Date: Wed, 25 Jul 2012 07:36:43 -0700 (PDT)
Local: Wed, Jul 25 2012 10:36 am
Subject: Re: BackgroundJob corrupts long queries?

update: On production environment this process fails in 5 minutes, number
of processed rows seems to be the same. So, obsolete cursor is definitely
not a reason.
Any ideas?

среда, 18 июля 2012 г., 19:19:58 UTC+4 пользователь Anton Volokhov написал:

среда, 18 июля 2012 г., 19:19:58 UTC+4 пользователь Anton Volokhov написал:

среда, 18 июля 2012 г., 19:19:58 UTC+4 пользователь Anton Volokhov написал:

среда, 18 июля 2012 г., 19:19:58 UTC+4 пользователь Anton Volokhov написал:

...

read more »


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Randolph Tan  
View profile  
 More options Aug 31 2012, 12:16 pm
From: Randolph Tan <rando...@10gen.com>
Date: Fri, 31 Aug 2012 09:16:39 -0700 (PDT)
Local: Fri, Aug 31 2012 12:16 pm
Subject: Re: BackgroundJob corrupts long queries?

Hi,

This is actually a known bug in mongos
(https://jira.mongodb.org/browse/SERVER-5157) which is already fixed in 2.2.

...

read more »


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Anton Volokhov  
View profile   Translate to Translated (View Original)
 More options Sep 1 2012, 12:26 pm
From: Anton Volokhov <a.v.volok...@gmail.com>
Date: Sat, 1 Sep 2012 09:26:47 -0700 (PDT)
Local: Sat, Sep 1 2012 12:26 pm
Subject: Re: BackgroundJob corrupts long queries?

Thank you! Hope, on 2.2 everything will be ok.

пятница, 31 августа 2012 г., 20:16:39 UTC+4 пользователь Randolph Tan
написал:

...

read more »


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »