2014-08-15T08:34:01.917+0530 [initandlisten] MongoDB starting : pid=20362 port=27011 dbpath=/mongo/mongod27011 64-bit host=ACL-MONGO-LSRV4 2014-08-15T08:34:01.917+0530 [initandlisten] db version v2.6.1 2014-08-15T08:34:01.917+0530 [initandlisten] git version: 4b95b086d2374bdcfcdf2249272fb552c9c726e8 2014-08-15T08:34:01.917+0530 [initandlisten] build info: Linux build14.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2014-08-15T08:34:01.917+0530 [initandlisten] allocator: tcmalloc 2014-08-15T08:34:01.917+0530 [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "Secondary,127.0.0.1", port: 27011 }, operationProfiling: { mode: "slowOp", slowOpThresholdMs: 1000 }, processManagement: { fork: true }, replication: { oplogSizeMB: 25600, replSet: "rs1" }, storage: { dbPath: "/mongo/mongod27011", journal: { enabled: true } }, systemLog: { destination: "file", path: "/var/log/mongo/mongors1_27011" } } 2014-08-15T08:34:01.954+0530 [initandlisten] journal dir=/mongo/mongod27011/journal 2014-08-15T08:34:01.954+0530 [initandlisten] recover : no journal files present, no recovery needed 2014-08-15T08:34:02.129+0530 [initandlisten] preallocateIsFaster=true 2.38 2014-08-15T08:34:02.254+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.ns, filling with zeroes... 2014-08-15T08:34:02.254+0530 [FileAllocator] creating directory /mongo/mongod27011/_tmp 2014-08-15T08:34:02.256+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.ns, size: 16MB, took 0.001 secs 2014-08-15T08:34:02.259+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.0, filling with zeroes... 2014-08-15T08:34:02.302+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.0, size: 64MB, took 0.042 secs 2014-08-15T08:34:02.304+0530 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } 2014-08-15T08:34:02.304+0530 [initandlisten] added index to empty collection 2014-08-15T08:34:02.304+0530 [initandlisten] waiting for connections on port 27011 2014-08-15T08:34:02.307+0530 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) 2014-08-15T08:34:02.307+0530 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done 2014-08-15T08:34:02.350+0530 [initandlisten] connection accepted from Primary:48412 #1 (1 connection now open) 2014-08-15T08:34:02.507+0530 [initandlisten] connection accepted from Arbiter:56523 #2 (2 connections now open) 2014-08-15T08:34:02.524+0530 [conn2] end connection Arbiter:56523 (1 connection now open) 2014-08-15T08:34:02.524+0530 [initandlisten] connection accepted from Arbiter:56524 #3 (2 connections now open) 2014-08-15T08:34:03.307+0530 [rsStart] trying to contact Arbiter:27021 2014-08-15T08:34:03.341+0530 [initandlisten] connection accepted from xxxx:42492 #4 (3 connections now open) 2014-08-15T08:34:03.350+0530 [conn1] end connection Primary:48412 (2 connections now open) 2014-08-15T08:34:03.351+0530 [initandlisten] connection accepted from Primary:48413 #5 (3 connections now open) 2014-08-15T08:34:03.402+0530 [rsStart] replSet I am Secondary:27011 2014-08-15T08:34:03.402+0530 [rsStart] replSet got config version 4 from a remote, saving locally 2014-08-15T08:34:03.402+0530 [rsStart] replSet info saving a newer config version to local.system.replset: { _id: "rs1", version: 4, members: [ { _id: 0, host: "Secondary:27011" }, { _id: 1, host: "Primary:27011" }, { _id: 2, host: "Arbiter:27021", arbiterOnly: true } ] } 2014-08-15T08:34:03.410+0530 [rsStart] build index on: local.system.replset properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.system.replset" } 2014-08-15T08:34:03.410+0530 [rsStart] added index to empty collection 2014-08-15T08:34:03.410+0530 [rsStart] replSet saveConfigLocally done 2014-08-15T08:34:03.417+0530 [rsStart] build index on: local.me properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.me" } 2014-08-15T08:34:03.417+0530 [rsStart] added index to empty collection 2014-08-15T08:34:03.418+0530 [rsStart] replSet STARTUP2 2014-08-15T08:34:03.418+0530 [rsSync] ****** 2014-08-15T08:34:03.418+0530 [rsSync] creating replication oplog of size: 25600MB... 2014-08-15T08:34:03.418+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.1, filling with zeroes... 2014-08-15T08:34:03.517+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.1, size: 2047MB, took 0.098 secs 2014-08-15T08:34:03.518+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.2, filling with zeroes... 2014-08-15T08:34:03.543+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.2, size: 2047MB, took 0.025 secs 2014-08-15T08:34:03.543+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.3, filling with zeroes... 2014-08-15T08:34:03.638+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.3, size: 2047MB, took 0.095 secs 2014-08-15T08:34:03.639+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.4, filling with zeroes... 2014-08-15T08:34:03.651+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.4, size: 2047MB, took 0.012 secs 2014-08-15T08:34:03.652+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.5, filling with zeroes... 2014-08-15T08:34:03.713+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.5, size: 2047MB, took 0.061 secs 2014-08-15T08:34:03.713+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.6, filling with zeroes... 2014-08-15T08:34:03.729+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.6, size: 2047MB, took 0.015 secs 2014-08-15T08:34:03.729+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.7, filling with zeroes... 2014-08-15T08:34:03.744+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.7, size: 2047MB, took 0.014 secs 2014-08-15T08:34:03.744+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.8, filling with zeroes... 2014-08-15T08:34:03.756+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.8, size: 2047MB, took 0.011 secs 2014-08-15T08:34:03.756+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.9, filling with zeroes... 2014-08-15T08:34:03.767+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.9, size: 2047MB, took 0.011 secs 2014-08-15T08:34:03.768+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.10, filling with zeroes... 2014-08-15T08:34:03.785+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.10, size: 2047MB, took 0.017 secs 2014-08-15T08:34:03.786+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.11, filling with zeroes... 2014-08-15T08:34:03.795+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.11, size: 2047MB, took 0.008 secs 2014-08-15T08:34:03.795+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.12, filling with zeroes... 2014-08-15T08:34:03.810+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.12, size: 2047MB, took 0.015 secs 2014-08-15T08:34:03.811+0530 [FileAllocator] allocating new datafile /mongo/mongod27011/local.13, filling with zeroes... 2014-08-15T08:34:03.825+0530 [FileAllocator] done allocating datafile /mongo/mongod27011/local.13, size: 2047MB, took 0.014 secs 2014-08-15T08:34:03.840+0530 [rsSync] ****** 2014-08-15T08:34:03.840+0530 [rsSync] replSet initial sync pending 2014-08-15T08:34:03.840+0530 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync 2014-08-15T08:34:04.078+0530 [initandlisten] connection accepted from x.x.x.32:59180 #6 (4 connections now open) 2014-08-15T08:34:04.683+0530 [initandlisten] connection accepted from x.x.x.22:60830 #7 (5 connections now open) 2014-08-15T08:34:05.002+0530 [initandlisten] connection accepted from Arbiter:56526 #8 (6 connections now open) 2014-08-15T08:34:05.016+0530 [initandlisten] connection accepted from x.x.x.32:59181 #9 (7 connections now open) 2014-08-15T08:34:05.021+0530 [initandlisten] connection accepted from x.x.x.7:60804 #10 (8 connections now open) 2014-08-15T08:34:05.022+0530 [initandlisten] connection accepted from x.x.x.8:34636 #11 (9 connections now open) 2014-08-15T08:34:05.024+0530 [initandlisten] connection accepted from x.x.x.17:40962 #12 (10 connections now open) 2014-08-15T08:34:05.026+0530 [initandlisten] connection accepted from x.x.x.18:32826 #13 (11 connections now open) 2014-08-15T08:34:05.283+0530 [initandlisten] connection accepted from x.x.x.31:35557 #14 (12 connections now open) 2014-08-15T08:34:05.403+0530 [rsHealthPoll] replSet member Arbiter:27021 is up 2014-08-15T08:34:05.403+0530 [rsHealthPoll] replSet member Arbiter:27021 is now in state ARBITER 2014-08-15T08:34:05.404+0530 [rsHealthPoll] replSet member Primary:27011 is up 2014-08-15T08:34:05.404+0530 [rsHealthPoll] replSet member Primary:27011 is now in state PRIMARY 2014-08-15T08:34:05.569+0530 [initandlisten] connection accepted from x.x.x.25:42493 #15 (13 connections now open) 2014-08-15T08:34:05.976+0530 [initandlisten] connection accepted from x.x.x.16:57436 #16 (14 connections now open) 2014-08-15T08:34:05.977+0530 [initandlisten] connection accepted from x.x.x.17:40963 #17 (15 connections now open) 2014-08-15T08:34:06.761+0530 [initandlisten] connection accepted from x.x.x.7:60805 #18 (16 connections now open) 2014-08-15T08:34:07.641+0530 [initandlisten] connection accepted from x.x.x.23:49805 #19 (17 connections now open) 2014-08-15T08:34:07.690+0530 [initandlisten] connection accepted from Arbiter:56527 #20 (18 connections now open) 2014-08-15T08:34:07.696+0530 [initandlisten] connection accepted from Secondary:37957 #21 (19 connections now open) 2014-08-15T08:34:07.735+0530 [initandlisten] connection accepted from Primary:48415 #22 (20 connections now open) 2014-08-15T08:34:08.029+0530 [initandlisten] connection accepted from x.x.x.27:60269 #23 (21 connections now open) 2014-08-15T08:34:08.582+0530 [initandlisten] connection accepted from x.x.x.31:35558 #24 (22 connections now open) 2014-08-15T08:34:08.933+0530 [initandlisten] connection accepted from x.x.x.26:47359 #25 (23 connections now open) 2014-08-15T08:34:09.182+0530 [initandlisten] connection accepted from Arbiter:56528 #26 (24 connections now open) 2014-08-15T08:34:09.572+0530 [initandlisten] connection accepted from x.x.x.18:32827 #27 (25 connections now open) 2014-08-15T08:34:10.955+0530 [initandlisten] connection accepted from x.x.x.33:60889 #28 (26 connections now open) 2014-08-15T08:34:11.210+0530 [initandlisten] connection accepted from x.x.x.8:34637 #29 (27 connections now open) 2014-08-15T08:34:11.396+0530 [conn5] end connection Primary:48413 (26 connections now open) 2014-08-15T08:34:11.396+0530 [initandlisten] connection accepted from Primary:48416 #30 (27 connections now open) 2014-08-15T08:34:19.841+0530 [rsSync] replSet initial sync pending 2014-08-15T08:34:19.841+0530 [rsSync] replSet syncing to: Primary:27011 2014-08-15T08:34:19.942+0530 [rsSync] build index on: local.replset.minvalid properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.replset.minvalid" } 2014-08-15T08:34:19.942+0530 [rsSync] added index to empty collection 2014-08-15T08:34:19.942+0530 [rsSync] replSet initial sync drop all databases 2014-08-15T08:34:19.942+0530 [rsSync] dropAllDatabasesExceptLocal 1 2014-08-15T08:34:19.942+0530 [rsSync] replSet initial sync clone all databases 2014-08-15T08:34:19.957+0530 [rsSync] replSet initial sync cloning db: database 2014-08-15T08:34:58.547+0530 [conn31] end connection Arbiter:56531 (26 connections now open) 2014-08-15T08:34:58.548+0530 [initandlisten] connection accepted from Arbiter:56537 #33 (27 connections now open) 2014-08-15T08:35:02.303+0530 [clientcursormon] mem (MB) res:280 virt:54725 2014-08-15T08:35:02.303+0530 [clientcursormon] mapped (incl journal view):53958 2014-08-15T08:35:02.303+0530 [clientcursormon] connections:27 2014-08-15T08:35:02.303+0530 [clientcursormon] replication threads:32 2014-08-15T08:35:02.568+0530 [FileAllocator] allocating new datafile xxxx 2014-08-15T08:35:02.745+0530 [FileAllocator] done allocating datafile xxxx size: 256MB, took 0.177 secs 2014-08-15T08:35:11.420+0530 [conn32] end connection Primary:48422 (26 connections now open) 2014-08-15T08:35:11.420+0530 [initandlisten] connection accepted from Primary:48428 #34 (27 connections now open) 2014-08-15T08:35:28.560+0530 [conn33] end connection Arbiter:56537 (26 connections now open) 2014-08-15T08:35:28.560+0530 [initandlisten] connection accepted from Arbiter:56543 #35 (27 connections now open) 2014-08-15T08:35:58.573+0530 [initandlisten] connection accepted from Arbiter:56549 #37 (27 connections now open) 2014-08-15T08:36:02.329+0530 [clientcursormon] mem (MB) res:658 virt:56261 2014-08-15T08:36:02.329+0530 [clientcursormon] mapped (incl journal view):55494 2014-08-15T08:36:02.329+0530 [clientcursormon] connections:27 2014-08-15T08:36:02.329+0530 [clientcursormon] replication threads:32 2014-08-15T08:36:11.648+0530 [conn36] end connection Primary:48434 (26 connections now open) 2014-08-15T08:36:11.649+0530 [initandlisten] connection accepted from Primary:48440 #38 (27 connections now open) 2014-08-15T08:36:28.584+0530 [conn37] end connection Arbiter:56549 (26 connections now open) 2014-08-15T08:36:28.585+0530 [initandlisten] connection accepted from Arbiter:56555 #39 (27 connections now open) 2014-08-15T08:36:41.660+0530 [conn38] end connection Primary:48440 (26 connections now open) 2014-08-15T08:36:41.661+0530 [initandlisten] connection accepted from Primary:48446 #40 (27 connections now open) 2014-08-15T08:36:58.597+0530 [conn39] end connection Arbiter:56555 (26 connections now open) 2014-08-15T08:36:58.598+0530 [initandlisten] connection accepted from Arbiter:56561 #41 (27 connections now open) 2014-08-15T08:37:02.332+0530 [clientcursormon] mem (MB) res:901 virt:58309 2014-08-15T08:37:02.333+0530 [clientcursormon] mapped (incl journal view):57542 2014-08-15T08:37:02.333+0530 [clientcursormon] connections:27 2014-08-15T08:37:02.333+0530 [clientcursormon] replication threads:32 2014-08-15T08:37:11.672+0530 [conn40] end connection Primary:48446 (26 connections now open) 2014-08-15T08:37:11.673+0530 [initandlisten] connection accepted from Primary:48452 #42 (27 connections now open) 2014-08-15T08:37:28.610+0530 [conn41] end connection Arbiter:56561 (26 connections now open) 2014-08-15T08:37:28.611+0530 [initandlisten] connection accepted from Arbiter:56567 #43 (27 connections now open) 2014-08-15T08:37:41.687+0530 [conn42] end connection Primary:48452 (26 connections now open) 2014-08-15T08:37:41.689+0530 [initandlisten] connection accepted from Primary:48458 #44 (27 connections now open) 2014-08-15T08:37:58.622+0530 [conn43] end connection Arbiter:56567 (26 connections now open) 2014-08-15T08:37:58.623+0530 [initandlisten] connection accepted from Arbiter:56573 #45 (27 connections now open) 2014-08-15T08:38:02.337+0530 [clientcursormon] mem (MB) res:1485 virt:58309 2014-08-15T08:38:02.337+0530 [clientcursormon] mapped (incl journal view):57542 2014-08-15T08:38:02.337+0530 [clientcursormon] connections:27 2014-08-15T08:38:02.337+0530 [clientcursormon] replication threads:32 2014-08-15T08:38:11.701+0530 [conn44] end connection Primary:48458 (26 connections now open) 2014-08-15T08:38:11.743+0530 [initandlisten] connection accepted from Primary:48464 #46 (27 connections now open) 2014-08-15T08:38:41.754+0530 [conn46] end connection Primary:48464 (26 connections now open) 2014-08-15T08:38:41.755+0530 [initandlisten] connection accepted from Primary:48470 #48 (27 connections now open) 2014-08-15T08:38:58.647+0530 [conn47] end connection Arbiter:56579 (26 connections now open) 2014-08-15T08:38:58.647+0530 [initandlisten] connection accepted from Arbiter:56585 #49 (27 connections now open) 2014-08-15T08:39:05.002+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.017+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.021+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.023+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.024+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.026+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.285+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:05.569+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:39:11.770+0530 [conn48] end connection Primary:48470 (26 connections now open) 2014-08-15T08:39:11.770+0530 [initandlisten] connection accepted from Primary:48476 #50 (27 connections now open) 2014-08-15T08:39:28.659+0530 [conn49] end connection Arbiter:56585 (26 connections now open) 2014-08-15T08:39:28.659+0530 [initandlisten] connection accepted from Arbiter:56591 #51 (27 connections now open) 2014-08-15T08:39:41.781+0530 [conn50] end connection Primary:48476 (26 connections now open) 2014-08-15T08:39:41.782+0530 [initandlisten] connection accepted from Primary:48482 #52 (27 connections now open) 2014-08-15T08:39:58.671+0530 [conn51] end connection Arbiter:56591 (26 connections now open) 2014-08-15T08:39:58.672+0530 [initandlisten] connection accepted from Arbiter:56597 #53 (27 connections now open) 2014-08-15T08:40:02.343+0530 [clientcursormon] mem (MB) res:1993 virt:62403 2014-08-15T08:40:02.343+0530 [clientcursormon] mapped (incl journal view):61636 2014-08-15T08:40:02.343+0530 [clientcursormon] connections:27 2014-08-15T08:40:02.343+0530 [clientcursormon] replication threads:32 2014-08-15T08:40:11.791+0530 [conn52] end connection Primary:48482 (26 connections now open) 2014-08-15T08:40:11.792+0530 [initandlisten] connection accepted from Primary:48488 #54 (27 connections now open) 2014-08-15T08:40:28.683+0530 [conn53] end connection Arbiter:56597 (26 connections now open) 2014-08-15T08:40:28.683+0530 [initandlisten] connection accepted from Arbiter:56603 #55 (27 connections now open) 2014-08-15T08:40:41.803+0530 [conn54] end connection Primary:48488 (26 connections now open) 2014-08-15T08:40:41.804+0530 [initandlisten] connection accepted from Primary:48494 #56 (27 connections now open) 2014-08-15T08:40:58.694+0530 [conn55] end connection Arbiter:56603 (26 connections now open) 2014-08-15T08:40:58.695+0530 [initandlisten] connection accepted from Arbiter:56609 #57 (27 connections now open) 2014-08-15T08:41:11.814+0530 [conn56] end connection Primary:48494 (26 connections now open) 2014-08-15T08:41:11.815+0530 [initandlisten] connection accepted from Primary:48500 #58 (27 connections now open) 2014-08-15T08:41:28.707+0530 [conn57] end connection Arbiter:56609 (26 connections now open) 2014-08-15T08:41:28.708+0530 [initandlisten] connection accepted from Arbiter:56615 #59 (27 connections now open) 2014-08-15T08:41:41.829+0530 [conn58] end connection Primary:48500 (26 connections now open) 2014-08-15T08:41:41.830+0530 [initandlisten] connection accepted from Primary:48506 #60 (27 connections now open) 2014-08-15T08:41:58.723+0530 [conn59] end connection Arbiter:56615 (26 connections now open) 2014-08-15T08:41:58.724+0530 [initandlisten] connection accepted from Arbiter:56621 #61 (27 connections now open) 2014-08-15T08:42:02.361+0530 [clientcursormon] mem (MB) res:2463 virt:62403 2014-08-15T08:42:02.361+0530 [clientcursormon] mapped (incl journal view):61636 2014-08-15T08:42:02.361+0530 [clientcursormon] connections:27 2014-08-15T08:42:02.361+0530 [clientcursormon] replication threads:32 2014-08-15T08:42:11.844+0530 [conn60] end connection Primary:48506 (26 connections now open) 2014-08-15T08:42:11.844+0530 [initandlisten] connection accepted from Primary:48512 #62 (27 connections now open) 2014-08-15T08:42:28.736+0530 [conn61] end connection Arbiter:56621 (26 connections now open) 2014-08-15T08:42:28.736+0530 [initandlisten] connection accepted from Arbiter:56627 #63 (27 connections now open) 2014-08-15T08:42:41.855+0530 [conn62] end connection Primary:48512 (26 connections now open) 2014-08-15T08:42:41.856+0530 [initandlisten] connection accepted from Primary:48518 #64 (27 connections now open) 2014-08-15T08:42:46.263+0530 [rsSync] clone xxx 2014-08-15T08:42:46.265+0530 [rsSync] 629711 objects cloned so far from collection xxxx 2014-08-15T08:42:58.748+0530 [conn63] end connection Arbiter:56627 (26 connections now open) 2014-08-15T08:42:58.749+0530 [initandlisten] connection accepted from Arbiter:56633 #65 (27 connections now open) 2014-08-15T08:43:11.870+0530 [conn64] end connection Primary:48518 (26 connections now open) 2014-08-15T08:43:11.871+0530 [initandlisten] connection accepted from Primary:48524 #66 (27 connections now open) 2014-08-15T08:43:28.759+0530 [conn65] end connection Arbiter:56633 (26 connections now open) 2014-08-15T08:43:28.760+0530 [initandlisten] connection accepted from Arbiter:56639 #67 (27 connections now open) 2014-08-15T08:43:41.881+0530 [conn66] end connection Primary:48524 (26 connections now open) 2014-08-15T08:43:41.882+0530 [initandlisten] connection accepted from Primary:48530 #68 (27 connections now open) 2014-08-15T08:43:47.829+0530 [rsSync] 649269 objects cloned so far from collection xxxx 2014-08-15T08:43:47.830+0530 [rsSync] clone xxxx 2014-08-15T08:43:58.771+0530 [conn67] end connection Arbiter:56639 (26 connections now open) 2014-08-15T08:43:58.772+0530 [initandlisten] connection accepted from Arbiter:56645 #69 (27 connections now open) 2014-08-15T08:44:05.003+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.018+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.022+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.023+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.025+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.027+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.286+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:05.570+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:44:11.893+0530 [conn68] end connection Primary:48530 (26 connections now open) 2014-08-15T08:44:11.894+0530 [initandlisten] connection accepted from Primary:48536 #70 (27 connections now open) 2014-08-15T08:44:28.783+0530 [conn69] end connection Arbiter:56645 (26 connections now open) 2014-08-15T08:44:28.783+0530 [initandlisten] connection accepted from Arbiter:56651 #71 (27 connections now open) 2014-08-15T08:44:41.905+0530 [conn70] end connection Primary:48536 (26 connections now open) 2014-08-15T08:44:41.905+0530 [initandlisten] connection accepted from Primary:48542 #72 (27 connections now open) 2014-08-15T08:44:48.204+0530 [rsSync] clone xxxx 2014-08-15T08:44:48.204+0530 [rsSync] 688131 xxxx 2014-08-15T08:44:58.796+0530 [conn71] end connection Arbiter:56651 (26 connections now open) 2014-08-15T08:44:58.796+0530 [initandlisten] connection accepted from Arbiter:56657 #73 (27 connections now open) 2014-08-15T08:45:02.371+0530 [clientcursormon] mem (MB) res:3007 virt:62403 2014-08-15T08:45:02.371+0530 [clientcursormon] mapped (incl journal view):61636 2014-08-15T08:45:02.371+0530 [clientcursormon] connections:27 2014-08-15T08:45:02.371+0530 [clientcursormon] replication threads:32 2014-08-15T08:45:11.917+0530 [conn72] end connection Primary:48542 (26 connections now open) 2014-08-15T08:45:11.917+0530 [initandlisten] connection accepted from Primary:48548 #74 (27 connections now open) 2014-08-15T08:45:28.808+0530 [conn73] end connection Arbiter:56657 (26 connections now open) 2014-08-15T08:45:28.808+0530 [initandlisten] connection accepted from Arbiter:56663 #75 (27 connections now open) 2014-08-15T08:45:41.929+0530 [conn74] end connection Primary:48548 (26 connections now open) 2014-08-15T08:45:41.930+0530 [initandlisten] connection accepted from Primary:48554 #76 (27 connections now open) 2014-08-15T08:45:48.279+0530 [rsSync] clone xxx 2014-08-15T08:45:49.116+0530 [rsSync] 806749 objects cloned so far from collection xxxx 2014-08-15T08:45:58.820+0530 [conn75] end connection Arbiter:56663 (26 connections now open) 2014-08-15T08:45:58.821+0530 [initandlisten] connection accepted from Arbiter:56669 #77 (27 connections now open) 2014-08-15T08:46:02.374+0530 [clientcursormon] mem (MB) res:3379 virt:62403 2014-08-15T08:46:02.374+0530 [clientcursormon] mapped (incl journal view):61636 2014-08-15T08:46:02.374+0530 [clientcursormon] connections:27 2014-08-15T08:46:02.374+0530 [clientcursormon] replication threads:32 2014-08-15T08:46:11.942+0530 [conn76] end connection Primary:48554 (26 connections now open) 2014-08-15T08:46:11.945+0530 [initandlisten] connection accepted from Primary:48560 #78 (27 connections now open) 2014-08-15T08:46:28.832+0530 [conn77] end connection Arbiter:56669 (26 connections now open) 2014-08-15T08:46:28.833+0530 [initandlisten] connection accepted from Arbiter:56675 #79 (27 connections now open) 2014-08-15T08:46:41.955+0530 [conn78] end connection Primary:48560 (26 connections now open) 2014-08-15T08:46:41.955+0530 [initandlisten] connection accepted from Primary:48566 #80 (27 connections now open) 2014-08-15T08:49:05.004+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.019+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.023+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.024+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.026+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.027+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.286+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:05.571+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T08:49:12.011+0530 [conn88] end connection Primary:48590 (26 connections now open) 2014-08-15T08:49:12.012+0530 [initandlisten] connection accepted from Primary:48596 #90 (27 connections now open) 2014-08-15T08:49:28.901+0530 [conn89] end connection Arbiter:56705 (26 connections now open) 2014-08-15T08:49:28.902+0530 [initandlisten] connection accepted from Arbiter:56711 #91 (27 connections now open) 2014-08-15T08:49:42.022+0530 [conn90] end connection Primary:48596 (26 connections now open) 2014-08-15T08:49:42.023+0530 [initandlisten] connection accepted from Primary:48602 #92 (27 connections now open) 2014-08-15T08:49:53.443+0530 [rsSync] clone db_TN_STORE_USER_PROFILE_2_12.col_TN_STORE_USER_PROFILE_2_12 981887 2014-08-15T08:49:58.915+0530 [conn91] end connection Arbiter:56711 (26 connections now open) 2014-08-15T09:59:08.352+0530 [rsSync] building index using bulk method 2014-08-15T09:59:11.000+0530 [rsSync] Index Build: 677500/1196512 56% 2014-08-15T09:59:14.087+0530 [conn370] end connection Primary:49431 (27 connections now open) 2014-08-15T09:59:14.088+0530 [initandlisten] connection accepted from Primary:49437 #372 (28 connections now open) 2014-08-15T09:59:17.656+0530 [rsSync] build index done. scanned 1196512 total records. 9.303 secs 2014-08-15T11:01:13.649+0530 [rsSync] building index using bulk method 2014-08-15T11:01:16.000+0530 [rsSync] Index Build: 574400/1018777 56% 2014-08-15T11:01:16.867+0530 [conn619] end connection Primary:50175 (26 connections now open) 2014-08-15T11:01:16.868+0530 [initandlisten] connection accepted from Primary:50181 #621 (27 connections now open) 2014-08-15T11:01:21.633+0530 [rsSync] build index done. scanned 1018777 total records. 7.983 secs 2014-08-15T11:01:21.757+0530 [rsSync] replSet initial sync data copy, starting syncup 2014-08-15T11:01:21.757+0530 [rsSync] oplog sync 1 of 3 2014-08-15T11:01:22.402+0530 [rsBackgroundSync] replSet syncing to: Primary:27011 2014-08-15T11:01:22.404+0530 [rsBackgroundSync] replSet error RS102 too stale to catch up, at least from Primary:27011 2014-08-15T11:01:22.404+0530 [rsBackgroundSync] replSet our last optime : Aug 15 08:34:19 53ed78b3:24 2014-08-15T11:01:22.404+0530 [rsBackgroundSync] replSet oldest at Primary:27011 : Aug 15 09:56:56 53ed8c10:4ab 2014-08-15T11:01:22.404+0530 [rsBackgroundSync] replSet See http://dochub.mongodb.org/core/resyncingaverystalereplicasetmember 2014-08-15T11:01:22.426+0530 [rsBackgroundSync] replSet error RS102 too stale to catch up 2014-08-15T11:01:22.426+0530 [rsBackgroundSync] replSet RECOVERING 2014-08-15T11:01:29.758+0530 [clientcursormon] mem (MB) res:109116 virt:254210 2014-08-15T11:01:29.758+0530 [clientcursormon] mapped (incl journal view):252898 2014-08-15T11:01:29.758+0530 [clientcursormon] connections:27 2014-08-15T11:01:29.758+0530 [clientcursormon] replication threads:32 2014-08-15T11:01:32.608+0530 [conn620] end connection Arbiter:58290 (26 connections now open) 2014-08-15T11:01:32.609+0530 [initandlisten] connection accepted from Arbiter:58296 #622 (27 connections now open) 2014-08-15T11:01:46.877+0530 [conn621] end connection Primary:50181 (26 connections now open) 2014-08-15T11:01:47.009+0530 [initandlisten] connection accepted from Primary:50187 #623 (27 connections now open) 2014-08-15T11:02:02.620+0530 [conn622] end connection Arbiter:58296 (26 connections now open) 2014-08-15T11:02:02.621+0530 [initandlisten] connection accepted from Arbiter:58302 #624 (27 connections now open) 2014-08-15T11:02:17.019+0530 [conn623] end connection Primary:50187 (26 connections now open) 2014-08-15T11:02:17.020+0530 [initandlisten] connection accepted from Primary:50193 #625 (27 connections now open) 2014-08-15T11:02:32.634+0530 [conn624] end connection Arbiter:58302 (26 connections now open) 2014-08-15T11:02:32.638+0530 [initandlisten] connection accepted from Arbiter:58308 #626 (27 connections now open) 2014-08-15T11:02:47.030+0530 [conn625] end connection Primary:50193 (26 connections now open) 2014-08-15T11:02:47.031+0530 [initandlisten] connection accepted from Primary:50199 #627 (27 connections now open) 2014-08-15T11:03:02.651+0530 [conn626] end connection Arbiter:58308 (26 connections now open) 2014-08-15T11:03:02.651+0530 [initandlisten] connection accepted from Arbiter:58314 #628 (27 connections now open) 2014-08-15T11:03:17.042+0530 [conn627] end connection Primary:50199 (26 connections now open) 2014-08-15T11:03:17.042+0530 [initandlisten] connection accepted from Primary:50205 #629 (27 connections now open) 2014-08-15T11:03:25.426+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 477 more seconds 2014-08-15T11:03:25.426+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 477 more seconds 2014-08-15T11:03:30.428+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 472 more seconds 2014-08-15T11:03:30.428+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 472 more seconds 2014-08-15T11:03:32.662+0530 [conn628] end connection Arbiter:58314 (26 connections now open) 2014-08-15T11:03:32.663+0530 [initandlisten] connection accepted from Arbiter:58320 #630 (27 connections now open) 2014-08-15T11:03:35.429+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 467 more seconds 2014-08-15T11:03:35.429+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 467 more seconds 2014-08-15T11:03:40.430+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 462 more seconds 2014-08-15T11:03:40.430+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 462 more seconds 2014-08-15T11:03:45.432+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 457 more seconds 2014-08-15T11:03:45.432+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 457 more seconds 2014-08-15T11:03:47.055+0530 [conn629] end connection Primary:50205 (26 connections now open) 2014-08-15T11:03:47.056+0530 [initandlisten] connection accepted from Primary:50211 #631 (27 connections now open) 2014-08-15T11:03:50.433+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 452 more seconds 2014-08-15T11:03:50.433+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 452 more seconds 2014-08-15T11:03:55.434+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 447 more seconds 2014-08-15T11:03:55.434+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 447 more seconds 2014-08-15T11:04:00.436+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 442 more seconds 2014-08-15T11:04:00.436+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 442 more seconds 2014-08-15T11:04:02.677+0530 [conn630] end connection Arbiter:58320 (26 connections now open) 2014-08-15T11:04:02.678+0530 [initandlisten] connection accepted from Arbiter:58326 #632 (27 connections now open) 2014-08-15T11:04:05.025+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.039+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.040+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.042+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.045+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.047+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:05.436+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 437 more seconds 2014-08-15T11:04:05.437+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 437 more seconds 2014-08-15T11:04:05.605+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:06.795+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:04:10.437+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 432 more seconds 2014-08-15T11:04:10.437+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 432 more seconds 2014-08-15T11:04:15.441+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 427 more seconds 2014-08-15T11:04:15.441+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 427 more seconds 2014-08-15T11:04:17.074+0530 [conn631] end connection Primary:50211 (26 connections now open) 2014-08-15T11:04:17.074+0530 [initandlisten] connection accepted from Primary:50217 #633 (27 connections now open) 2014-08-15T11:04:20.442+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 422 more seconds 2014-08-15T11:04:20.442+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 422 more seconds 2014-08-15T11:04:25.443+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 417 more seconds 2014-08-15T11:04:25.443+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 417 more seconds 2014-08-15T11:04:30.444+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 412 more seconds 2014-08-15T11:04:30.444+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 412 more seconds 2014-08-15T11:04:32.692+0530 [conn632] end connection Arbiter:58326 (26 connections now open) 2014-08-15T11:04:32.693+0530 [initandlisten] connection accepted from Arbiter:58332 #634 (27 connections now open) 2014-08-15T11:04:35.445+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 407 more seconds 2014-08-15T11:04:35.445+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 407 more seconds 2014-08-15T11:04:40.445+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 402 more seconds 2014-08-15T11:04:40.446+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 402 more seconds 2014-08-15T11:04:45.446+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 397 more seconds 2014-08-15T11:04:45.446+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 397 more seconds 2014-08-15T11:04:47.086+0530 [conn633] end connection Primary:50217 (26 connections now open) 2014-08-15T11:04:47.086+0530 [initandlisten] connection accepted from Primary:50223 #635 (27 connections now open) 2014-08-15T11:04:50.447+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 392 more seconds 2014-08-15T11:04:50.447+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 392 more seconds 2014-08-15T11:04:55.448+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 387 more seconds 2014-08-15T11:04:55.448+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 387 more seconds 2014-08-15T11:05:00.448+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 382 more seconds 2014-08-15T11:05:00.449+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 382 more seconds 2014-08-15T11:05:02.707+0530 [conn634] end connection Arbiter:58332 (26 connections now open) 2014-08-15T11:05:02.708+0530 [initandlisten] connection accepted from Arbiter:58339 #636 (27 connections now open) 2014-08-15T11:05:05.449+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 377 more seconds 2014-08-15T11:05:05.449+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 377 more seconds 2014-08-15T11:05:10.450+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 372 more seconds 2014-08-15T11:05:10.450+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 372 more seconds 2014-08-15T11:05:15.451+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 367 more seconds 2014-08-15T11:05:15.451+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 367 more seconds 2014-08-15T11:05:17.101+0530 [conn635] end connection Primary:50223 (26 connections now open) 2014-08-15T11:05:17.102+0530 [initandlisten] connection accepted from Primary:50229 #637 (27 connections now open) 2014-08-15T11:05:20.452+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 362 more seconds 2014-08-15T11:05:20.452+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 362 more seconds 2014-08-15T11:05:25.452+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 357 more seconds 2014-08-15T11:05:25.452+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 357 more seconds 2014-08-15T11:05:30.453+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 352 more seconds 2014-08-15T11:05:30.453+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 352 more seconds 2014-08-15T11:05:32.723+0530 [conn636] end connection Arbiter:58339 (26 connections now open) 2014-08-15T11:05:32.724+0530 [initandlisten] connection accepted from Arbiter:58345 #638 (27 connections now open) 2014-08-15T11:05:35.454+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 347 more seconds 2014-08-15T11:05:35.454+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 347 more seconds 2014-08-15T11:05:40.455+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 342 more seconds 2014-08-15T11:05:40.455+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 342 more seconds 2014-08-15T11:05:45.456+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 337 more seconds 2014-08-15T11:05:45.456+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 337 more seconds 2014-08-15T11:05:47.117+0530 [conn637] end connection Primary:50229 (26 connections now open) 2014-08-15T11:05:47.118+0530 [initandlisten] connection accepted from Primary:50235 #639 (27 connections now open) 2014-08-15T11:05:50.456+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 332 more seconds 2014-08-15T11:05:50.457+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 332 more seconds 2014-08-15T11:05:55.457+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 327 more seconds 2014-08-15T11:05:55.457+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 327 more seconds 2014-08-15T11:06:00.458+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 322 more seconds 2014-08-15T11:06:00.458+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 322 more seconds 2014-08-15T11:06:02.738+0530 [conn638] end connection Arbiter:58345 (26 connections now open) 2014-08-15T11:06:02.739+0530 [initandlisten] connection accepted from Arbiter:58351 #640 (27 connections now open) 2014-08-15T11:06:05.459+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 317 more seconds 2014-08-15T11:06:05.459+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 317 more seconds 2014-08-15T11:06:10.460+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 312 more seconds 2014-08-15T11:06:10.460+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 312 more seconds 2014-08-15T11:06:15.461+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 307 more seconds 2014-08-15T11:06:15.461+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 307 more seconds 2014-08-15T11:06:17.137+0530 [conn639] end connection Primary:50235 (26 connections now open) 2014-08-15T11:06:17.138+0530 [initandlisten] connection accepted from Primary:50241 #641 (27 connections now open) 2014-08-15T11:06:20.462+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 302 more seconds 2014-08-15T11:06:20.462+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 302 more seconds 2014-08-15T11:06:25.463+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 297 more seconds 2014-08-15T11:06:25.463+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 297 more seconds 2014-08-15T11:06:29.787+0530 [clientcursormon] mem (MB) res:109116 virt:254210 2014-08-15T11:06:29.787+0530 [clientcursormon] mapped (incl journal view):252898 2014-08-15T11:06:29.787+0530 [clientcursormon] connections:27 2014-08-15T11:06:29.787+0530 [clientcursormon] replication threads:32 2014-08-15T11:06:30.463+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 292 more seconds 2014-08-15T11:06:30.463+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 292 more seconds 2014-08-15T11:06:32.753+0530 [conn640] end connection Arbiter:58351 (26 connections now open) 2014-08-15T11:06:32.754+0530 [initandlisten] connection accepted from Arbiter:58357 #642 (27 connections now open) 2014-08-15T11:06:35.464+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 287 more seconds 2014-08-15T11:06:35.464+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 287 more seconds 2014-08-15T11:06:40.465+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 282 more seconds 2014-08-15T11:06:40.465+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 282 more seconds 2014-08-15T11:06:45.467+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 277 more seconds 2014-08-15T11:06:45.467+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 277 more seconds 2014-08-15T11:06:47.150+0530 [conn641] end connection Primary:50241 (26 connections now open) 2014-08-15T11:06:47.151+0530 [initandlisten] connection accepted from Primary:50247 #643 (27 connections now open) 2014-08-15T11:06:50.467+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 272 more seconds 2014-08-15T11:06:50.467+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 272 more seconds 2014-08-15T11:06:55.468+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 267 more seconds 2014-08-15T11:06:55.468+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 267 more seconds 2014-08-15T11:07:00.470+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 262 more seconds 2014-08-15T11:07:00.470+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 262 more seconds 2014-08-15T11:07:02.767+0530 [conn642] end connection Arbiter:58357 (26 connections now open) 2014-08-15T11:07:02.768+0530 [initandlisten] connection accepted from Arbiter:58363 #644 (27 connections now open) 2014-08-15T11:07:05.471+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 257 more seconds 2014-08-15T11:07:05.471+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 257 more seconds 2014-08-15T11:07:10.471+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 252 more seconds 2014-08-15T11:07:10.472+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 252 more seconds 2014-08-15T11:07:15.472+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 247 more seconds 2014-08-15T11:07:15.472+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 247 more seconds 2014-08-15T11:07:17.162+0530 [conn643] end connection Primary:50247 (26 connections now open) 2014-08-15T11:07:17.163+0530 [initandlisten] connection accepted from Primary:50253 #645 (27 connections now open) 2014-08-15T11:07:20.473+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 242 more seconds 2014-08-15T11:07:20.473+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 242 more seconds 2014-08-15T11:07:25.474+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 237 more seconds 2014-08-15T11:07:25.474+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 237 more seconds 2014-08-15T11:07:30.475+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 232 more seconds 2014-08-15T11:07:30.475+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 232 more seconds 2014-08-15T11:07:32.779+0530 [conn644] end connection Arbiter:58363 (26 connections now open) 2014-08-15T11:07:32.780+0530 [initandlisten] connection accepted from Arbiter:58369 #646 (27 connections now open) 2014-08-15T11:07:35.475+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 227 more seconds 2014-08-15T11:07:35.475+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 227 more seconds 2014-08-15T11:07:40.476+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 222 more seconds 2014-08-15T11:07:40.476+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 222 more seconds 2014-08-15T11:07:45.477+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 217 more seconds 2014-08-15T11:07:45.477+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 217 more seconds 2014-08-15T11:07:47.180+0530 [conn645] end connection Primary:50253 (26 connections now open) 2014-08-15T11:07:47.181+0530 [initandlisten] connection accepted from Primary:50259 #647 (27 connections now open) 2014-08-15T11:07:50.478+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 212 more seconds 2014-08-15T11:07:50.478+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 212 more seconds 2014-08-15T11:07:55.478+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 207 more seconds 2014-08-15T11:07:55.478+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 207 more seconds 2014-08-15T11:08:00.479+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 202 more seconds 2014-08-15T11:08:00.479+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 202 more seconds 2014-08-15T11:08:02.791+0530 [conn646] end connection Arbiter:58369 (26 connections now open) 2014-08-15T11:08:02.791+0530 [initandlisten] connection accepted from Arbiter:58375 #648 (27 connections now open) 2014-08-15T11:08:05.480+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 197 more seconds 2014-08-15T11:08:05.480+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 197 more seconds 2014-08-15T11:08:10.480+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 192 more seconds 2014-08-15T11:08:10.480+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 192 more seconds 2014-08-15T11:08:15.481+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 187 more seconds 2014-08-15T11:08:15.481+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 187 more seconds 2014-08-15T11:08:17.192+0530 [conn647] end connection Primary:50259 (26 connections now open) 2014-08-15T11:08:17.193+0530 [initandlisten] connection accepted from Primary:50265 #649 (27 connections now open) 2014-08-15T11:08:20.482+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 182 more seconds 2014-08-15T11:08:20.482+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 182 more seconds 2014-08-15T11:08:25.483+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 177 more seconds 2014-08-15T11:08:25.483+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 177 more seconds 2014-08-15T11:08:30.483+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 172 more seconds 2014-08-15T11:08:30.483+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 172 more seconds 2014-08-15T11:08:32.803+0530 [conn648] end connection Arbiter:58375 (26 connections now open) 2014-08-15T11:08:32.804+0530 [initandlisten] connection accepted from Arbiter:58381 #650 (27 connections now open) 2014-08-15T11:08:35.484+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 167 more seconds 2014-08-15T11:08:35.484+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 167 more seconds 2014-08-15T11:08:40.485+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 162 more seconds 2014-08-15T11:08:40.485+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 162 more seconds 2014-08-15T11:08:45.486+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 157 more seconds 2014-08-15T11:08:45.487+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 157 more seconds 2014-08-15T11:08:47.203+0530 [conn649] end connection Primary:50265 (26 connections now open) 2014-08-15T11:08:47.203+0530 [initandlisten] connection accepted from Primary:50271 #651 (27 connections now open) 2014-08-15T11:08:50.488+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 152 more seconds 2014-08-15T11:08:50.488+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 152 more seconds 2014-08-15T11:08:55.488+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 147 more seconds 2014-08-15T11:08:55.489+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 147 more seconds 2014-08-15T11:09:00.490+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 142 more seconds 2014-08-15T11:09:00.490+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 142 more seconds 2014-08-15T11:09:02.815+0530 [conn650] end connection Arbiter:58381 (26 connections now open) 2014-08-15T11:09:02.815+0530 [initandlisten] connection accepted from Arbiter:58387 #652 (27 connections now open) 2014-08-15T11:09:05.026+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.040+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.041+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.042+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.046+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.047+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:05.491+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 137 more seconds 2014-08-15T11:09:05.491+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 137 more seconds 2014-08-15T11:09:05.606+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:06.796+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:09:10.492+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 132 more seconds 2014-08-15T11:09:10.492+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 132 more seconds 2014-08-15T11:09:15.493+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 127 more seconds 2014-08-15T11:09:15.493+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 127 more seconds 2014-08-15T11:09:17.214+0530 [conn651] end connection Primary:50271 (26 connections now open) 2014-08-15T11:09:17.215+0530 [initandlisten] connection accepted from Primary:50277 #653 (27 connections now open) 2014-08-15T11:09:20.494+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 122 more seconds 2014-08-15T11:09:20.495+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 122 more seconds 2014-08-15T11:09:25.495+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 117 more seconds 2014-08-15T11:09:25.495+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 117 more seconds 2014-08-15T11:09:30.496+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 112 more seconds 2014-08-15T11:09:30.496+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 112 more seconds 2014-08-15T11:09:32.826+0530 [conn652] end connection Arbiter:58387 (26 connections now open) 2014-08-15T11:09:32.826+0530 [initandlisten] connection accepted from Arbiter:58393 #654 (27 connections now open) 2014-08-15T11:09:35.497+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 107 more seconds 2014-08-15T11:09:35.497+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 107 more seconds 2014-08-15T11:09:40.497+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 102 more seconds 2014-08-15T11:09:40.497+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 102 more seconds 2014-08-15T11:09:45.498+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 97 more seconds 2014-08-15T11:09:45.498+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 97 more seconds 2014-08-15T11:09:47.224+0530 [conn653] end connection Primary:50277 (26 connections now open) 2014-08-15T11:09:47.225+0530 [initandlisten] connection accepted from Primary:50283 #655 (27 connections now open) 2014-08-15T11:09:50.499+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 92 more seconds 2014-08-15T11:09:50.499+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 92 more seconds 2014-08-15T11:09:55.500+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 87 more seconds 2014-08-15T11:09:55.500+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 87 more seconds 2014-08-15T11:10:00.500+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 82 more seconds 2014-08-15T11:10:00.500+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 82 more seconds 2014-08-15T11:10:02.838+0530 [conn654] end connection Arbiter:58393 (26 connections now open) 2014-08-15T11:10:02.838+0530 [initandlisten] connection accepted from Arbiter:58399 #656 (27 connections now open) 2014-08-15T11:10:05.501+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 77 more seconds 2014-08-15T11:10:05.501+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 77 more seconds 2014-08-15T11:10:10.502+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 72 more seconds 2014-08-15T11:10:10.502+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 72 more seconds 2014-08-15T11:10:15.502+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 67 more seconds 2014-08-15T11:10:15.503+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 67 more seconds 2014-08-15T11:10:17.235+0530 [conn655] end connection Primary:50283 (26 connections now open) 2014-08-15T11:10:17.236+0530 [initandlisten] connection accepted from Primary:50289 #657 (27 connections now open) 2014-08-15T11:10:19.710+0530 [initandlisten] connection accepted from 127.0.0.1:53004 #658 (28 connections now open) 2014-08-15T11:10:20.503+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 62 more seconds 2014-08-15T11:10:20.503+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 62 more seconds 2014-08-15T11:10:25.504+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 57 more seconds 2014-08-15T11:10:25.504+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 57 more seconds 2014-08-15T11:10:30.505+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 52 more seconds 2014-08-15T11:10:30.505+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 52 more seconds 2014-08-15T11:10:32.849+0530 [conn656] end connection Arbiter:58399 (27 connections now open) 2014-08-15T11:10:32.850+0530 [initandlisten] connection accepted from Arbiter:58405 #659 (28 connections now open) 2014-08-15T11:10:35.505+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 47 more seconds 2014-08-15T11:10:35.506+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 47 more seconds 2014-08-15T11:10:38.282+0530 [conn658] end connection 127.0.0.1:53004 (27 connections now open) 2014-08-15T11:10:40.506+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 42 more seconds 2014-08-15T11:10:40.506+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 42 more seconds 2014-08-15T11:10:45.507+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 37 more seconds 2014-08-15T11:10:45.507+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 37 more seconds 2014-08-15T11:10:47.246+0530 [conn657] end connection Primary:50289 (26 connections now open) 2014-08-15T11:10:47.247+0530 [initandlisten] connection accepted from Primary:50295 #660 (27 connections now open) 2014-08-15T11:10:50.508+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 32 more seconds 2014-08-15T11:10:50.508+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 32 more seconds 2014-08-15T11:10:55.509+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 27 more seconds 2014-08-15T11:10:55.509+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 27 more seconds 2014-08-15T11:11:00.509+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 22 more seconds 2014-08-15T11:11:00.510+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 22 more seconds 2014-08-15T11:11:02.862+0530 [conn659] end connection Arbiter:58405 (26 connections now open) 2014-08-15T11:11:02.863+0530 [initandlisten] connection accepted from Arbiter:58411 #661 (27 connections now open) 2014-08-15T11:11:05.510+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 17 more seconds 2014-08-15T11:11:05.510+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 17 more seconds 2014-08-15T11:11:10.511+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 12 more seconds 2014-08-15T11:11:10.511+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 12 more seconds 2014-08-15T11:11:15.512+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 7 more seconds 2014-08-15T11:11:15.512+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 7 more seconds 2014-08-15T11:11:17.258+0530 [conn660] end connection Primary:50295 (26 connections now open) 2014-08-15T11:11:17.258+0530 [initandlisten] connection accepted from Primary:50301 #662 (27 connections now open) 2014-08-15T11:11:20.512+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 2 more seconds 2014-08-15T11:11:20.513+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 2 more seconds 2014-08-15T11:11:23.513+0530 [rsBackgroundSync] replSet syncing to: Primary:27011 2014-08-15T11:11:23.515+0530 [rsBackgroundSync] replSet error RS102 too stale to catch up, at least from Primary:27011 2014-08-15T11:11:23.515+0530 [rsBackgroundSync] replSet our last optime : Aug 15 08:34:19 53ed78b3:24 2014-08-15T11:11:23.515+0530 [rsBackgroundSync] replSet oldest at Primary:27011 : Aug 15 10:01:36 53ed8d28:4c 2014-08-15T11:11:23.515+0530 [rsBackgroundSync] replSet See http://dochub.mongodb.org/core/resyncingaverystalereplicasetmember 2014-08-15T11:11:23.532+0530 [rsBackgroundSync] replSet error RS102 too stale to catch up 2014-08-15T11:11:29.815+0530 [clientcursormon] mem (MB) res:109116 virt:254210 2014-08-15T11:11:29.815+0530 [clientcursormon] mapped (incl journal view):252898 2014-08-15T11:11:29.815+0530 [clientcursormon] connections:27 2014-08-15T11:11:29.815+0530 [clientcursormon] replication threads:32 2014-08-15T11:11:32.874+0530 [conn661] end connection Arbiter:58411 (26 connections now open) 2014-08-15T11:11:32.875+0530 [initandlisten] connection accepted from Arbiter:58417 #663 (27 connections now open) 2014-08-15T11:11:47.274+0530 [conn662] end connection Primary:50301 (26 connections now open) 2014-08-15T11:11:47.274+0530 [initandlisten] connection accepted from Primary:50307 #664 (27 connections now open) 2014-08-15T11:12:02.887+0530 [conn663] end connection Arbiter:58417 (26 connections now open) 2014-08-15T11:12:02.888+0530 [initandlisten] connection accepted from Arbiter:58423 #665 (27 connections now open) 2014-08-15T11:12:17.287+0530 [conn664] end connection Primary:50307 (26 connections now open) 2014-08-15T11:12:17.288+0530 [initandlisten] connection accepted from Primary:50313 #666 (27 connections now open) 2014-08-15T11:12:32.900+0530 [conn665] end connection Arbiter:58423 (26 connections now open) 2014-08-15T11:12:32.900+0530 [initandlisten] connection accepted from Arbiter:58429 #667 (27 connections now open) 2014-08-15T11:12:47.298+0530 [conn666] end connection Primary:50313 (26 connections now open) 2014-08-15T11:12:47.299+0530 [initandlisten] connection accepted from Primary:50319 #668 (27 connections now open) 2014-08-15T11:13:02.912+0530 [conn667] end connection Arbiter:58429 (26 connections now open) 2014-08-15T11:13:02.912+0530 [initandlisten] connection accepted from Arbiter:58435 #669 (27 connections now open) 2014-08-15T11:13:17.322+0530 [conn668] end connection Primary:50319 (26 connections now open) 2014-08-15T11:13:17.325+0530 [initandlisten] connection accepted from Primary:50325 #670 (27 connections now open) 2014-08-15T11:13:25.533+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 478 more seconds 2014-08-15T11:13:25.533+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 478 more seconds 2014-08-15T11:13:30.533+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 473 more seconds 2014-08-15T11:13:30.533+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 473 more seconds 2014-08-15T11:13:32.929+0530 [conn669] end connection Arbiter:58435 (26 connections now open) 2014-08-15T11:13:32.930+0530 [initandlisten] connection accepted from Arbiter:58441 #671 (27 connections now open) 2014-08-15T11:13:35.534+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 468 more seconds 2014-08-15T11:13:35.534+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 468 more seconds 2014-08-15T11:13:40.535+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 463 more seconds 2014-08-15T11:13:40.535+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 463 more seconds 2014-08-15T11:13:45.536+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 458 more seconds 2014-08-15T11:13:45.536+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 458 more seconds 2014-08-15T11:13:47.338+0530 [conn670] end connection Primary:50325 (26 connections now open) 2014-08-15T11:13:47.339+0530 [initandlisten] connection accepted from Primary:50331 #672 (27 connections now open) 2014-08-15T11:13:50.537+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 453 more seconds 2014-08-15T11:13:50.537+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 453 more seconds 2014-08-15T11:13:55.538+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 448 more seconds 2014-08-15T11:13:55.538+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 448 more seconds 2014-08-15T11:14:00.538+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 443 more seconds 2014-08-15T11:14:00.539+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 443 more seconds 2014-08-15T11:14:02.940+0530 [conn671] end connection Arbiter:58441 (26 connections now open) 2014-08-15T11:14:02.940+0530 [initandlisten] connection accepted from Arbiter:58447 #673 (27 connections now open) 2014-08-15T11:14:05.027+0530 [conn8] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc43d429aac2a013bbe25') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.041+0530 [conn9] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53b7238fa3c2fc4f399d430f') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.041+0530 [conn10] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfe37114393bcbfc59e2dd') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.043+0530 [conn12] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfda689b3f9287fd61fa97') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.047+0530 [conn11] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc50ccbac799a6d9da8c8') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.048+0530 [conn13] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfc5344fe0e2debbacc83d') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:05.539+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 438 more seconds 2014-08-15T11:14:05.539+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 438 more seconds 2014-08-15T11:14:05.606+0530 [conn15] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfd9e729e8c431b533398e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:06.841+0530 [conn14] command admin.$cmd command: writebacklisten { writebacklisten: ObjectId('53bfdab284c2811ec236542e') } ntoreturn:1 keyUpdates:0 numYields:0 reslen:44 300000ms 2014-08-15T11:14:10.540+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 433 more seconds 2014-08-15T11:14:10.540+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 433 more seconds 2014-08-15T11:14:15.541+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 428 more seconds 2014-08-15T11:14:15.541+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 428 more seconds 2014-08-15T11:14:17.351+0530 [conn672] end connection Primary:50331 (26 connections now open) 2014-08-15T11:14:17.352+0530 [initandlisten] connection accepted from Primary:50337 #674 (27 connections now open) 2014-08-15T11:14:20.542+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 423 more seconds 2014-08-15T11:14:20.542+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 423 more seconds 2014-08-15T11:14:25.542+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 418 more seconds 2014-08-15T11:14:25.542+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 418 more seconds 2014-08-15T11:14:30.543+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 413 more seconds 2014-08-15T11:14:30.543+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 413 more seconds 2014-08-15T11:14:32.953+0530 [conn673] end connection Arbiter:58447 (26 connections now open) 2014-08-15T11:14:32.953+0530 [initandlisten] connection accepted from Arbiter:58453 #675 (27 connections now open) 2014-08-15T11:14:35.544+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 408 more seconds 2014-08-15T11:14:35.544+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 408 more seconds 2014-08-15T11:14:40.545+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 403 more seconds 2014-08-15T11:14:40.545+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 403 more seconds 2014-08-15T11:14:45.546+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 398 more seconds 2014-08-15T11:14:45.546+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 398 more seconds 2014-08-15T11:14:47.363+0530 [conn674] end connection Primary:50337 (26 connections now open) 2014-08-15T11:14:47.364+0530 [initandlisten] connection accepted from Primary:50343 #676 (27 connections now open) 2014-08-15T11:14:50.547+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 393 more seconds 2014-08-15T11:14:50.547+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 393 more seconds 2014-08-15T11:14:55.548+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 388 more seconds 2014-08-15T11:14:55.548+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 388 more seconds 2014-08-15T11:15:00.548+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 383 more seconds 2014-08-15T11:15:00.549+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 383 more seconds 2014-08-15T11:15:02.965+0530 [conn675] end connection Arbiter:58453 (26 connections now open) 2014-08-15T11:15:02.965+0530 [initandlisten] connection accepted from Arbiter:58459 #677 (27 connections now open) 2014-08-15T11:15:05.551+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 378 more seconds 2014-08-15T11:15:05.551+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 378 more seconds 2014-08-15T11:15:10.551+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 373 more seconds 2014-08-15T11:15:10.551+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 373 more seconds 2014-08-15T11:15:15.552+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 368 more seconds 2014-08-15T11:15:15.552+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 368 more seconds 2014-08-15T11:15:17.374+0530 [conn676] end connection Primary:50343 (26 connections now open) 2014-08-15T11:15:17.375+0530 [initandlisten] connection accepted from Primary:50349 #678 (27 connections now open) 2014-08-15T11:15:20.553+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 363 more seconds 2014-08-15T11:15:20.553+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 363 more seconds 2014-08-15T11:15:25.554+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 358 more seconds 2014-08-15T11:15:25.554+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 358 more seconds 2014-08-15T11:15:30.555+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 353 more seconds 2014-08-15T11:15:30.555+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 353 more seconds 2014-08-15T11:15:32.976+0530 [conn677] end connection Arbiter:58459 (26 connections now open) 2014-08-15T11:15:32.977+0530 [initandlisten] connection accepted from Arbiter:58465 #679 (27 connections now open) 2014-08-15T11:15:35.555+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 348 more seconds 2014-08-15T11:15:35.555+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 348 more seconds 2014-08-15T11:15:40.556+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 343 more seconds 2014-08-15T11:15:40.556+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 343 more seconds 2014-08-15T11:15:45.557+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 338 more seconds 2014-08-15T11:15:45.557+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 338 more seconds 2014-08-15T11:15:47.384+0530 [conn678] end connection Primary:50349 (26 connections now open) 2014-08-15T11:15:47.385+0530 [initandlisten] connection accepted from Primary:50355 #680 (27 connections now open) 2014-08-15T11:15:50.557+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 333 more seconds 2014-08-15T11:15:50.558+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 333 more seconds 2014-08-15T11:15:55.558+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 328 more seconds 2014-08-15T11:15:55.558+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 328 more seconds 2014-08-15T11:16:00.559+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 323 more seconds 2014-08-15T11:16:00.559+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 323 more seconds 2014-08-15T11:16:02.987+0530 [conn679] end connection Arbiter:58465 (26 connections now open) 2014-08-15T11:16:02.988+0530 [initandlisten] connection accepted from Arbiter:58471 #681 (27 connections now open) 2014-08-15T11:16:05.560+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 318 more seconds 2014-08-15T11:16:05.560+0530 [rsBackgroundSync] replSet not trying to sync from Primary:27011, it is vetoed for 318 more seconds