Running into some problems doing what the subject says. One twist is that the snapshots may not have the same rs.conf which is needed on the new stack.
This is a simple set with primary, secondary, arb.
To that end, I have the following sequence of operations:
1) create volumes from snapshots <= works fine 2) attach volumes <= works fine 3) mdadm --assemble ..... <= works fine 4) mount /dev/mdXXX /mountpoint <= works fine 5) rm -rf /path/to/data/local.* <= works fine 6) rm -rf /path/to/data/mongod.lock <= works fine 7) service mongodb start <= works fine 8) mongo script_which_does_rs.initiate() <= Not so good
This gets me the message that db2 in the set 'has data'. db2 shows:
> show dbs;
admin (empty) local (empty) test 0.203125GB
so for the sake of completeness, I stopped mongo, removed the test.* files and restarted mongodb. This gives:
> show dbs; local (empty)
and after waiting a few minutes, I see that the 'admin' database has appeared.
Trying to rs.initiate() from db1, it tells me that db2 is 'not ok'. After waiting a few more minutes I try again, and it works.....
So... from all this, how should I formulate an exact, programmatically repeatable sequence of steps by which I can bring up a replSet from old EC2 snapshots?
Not quite sure I follow.
When you did an initiate, you should have created a single node
replica set, is that correct?
What was in the dbpath at that point?
Can you share the log?
On Sat, May 12, 2012 at 2:04 PM, Michael <mich...@visv.net> wrote:
> Running into some problems doing what the subject says. One twist is that
> the snapshots may not have the same rs.conf which is needed on the new
> stack.
> This is a simple set with primary, secondary, arb.
> To that end, I have the following sequence of operations:
> 1) create volumes from snapshots <= works fine
> 2) attach volumes <= works fine
> 3) mdadm --assemble ..... <= works fine
> 4) mount /dev/mdXXX /mountpoint <= works fine
> 5) rm -rf /path/to/data/local.* <= works fine
> 6) rm -rf /path/to/data/mongod.lock <= works fine
> 7) service mongodb start <= works fine
> 8) mongo script_which_does_rs.initiate() <= Not so good
> This gets me the message that db2 in the set 'has data'. db2 shows:
>> show dbs;
> admin (empty)
> local (empty)
> test 0.203125GB
> so for the sake of completeness, I stopped mongo, removed the test.* files
> and restarted mongodb. This gives:
>> show dbs;
> local (empty)
> and after waiting a few minutes, I see that the 'admin' database has
> appeared.
> Trying to rs.initiate() from db1, it tells me that db2 is 'not ok'. After
> waiting a few more minutes I try again, and it works.....
> So... from all this, how should I formulate an exact, programmatically
> repeatable sequence of steps by which I can bring up a replSet from old
> EC2 snapshots?
> TIA.
> --
> You received this message because you are subscribed to the Google Groups
> "mongodb-user" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/mongodb-user/-/e2ImFad8bIgJ.
> To post to this group, send email to mongodb-user@googlegroups.com.
> To unsubscribe from this group, send email to
> mongodb-user+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/mongodb-user?hl=en.
On Saturday, 12 May 2012 22:20:17 UTC-4, Eliot Horowitz wrote:
> Not quite sure I follow. > When you did an initiate, you should have created a single node > replica set, is that correct? > What was in the dbpath at that point? > Can you share the log?
> Ah, no. This is an AWS cloudformation stack launch, so all three members
are up and running, just not happy with their replSet configuration. The dbpath is fine, and the datafiles, etc. are all there.
On Sun, May 13, 2012 at 1:34 AM, Michael <mich...@visv.net> wrote:
> On Saturday, 12 May 2012 22:20:17 UTC-4, Eliot Horowitz wrote:
>> Not quite sure I follow.
>> When you did an initiate, you should have created a single node
>> replica set, is that correct?
>> What was in the dbpath at that point?
>> Can you share the log?
> Ah, no. This is an AWS cloudformation stack launch, so all three members are
> up and running, just not happy with their replSet configuration. The dbpath
> is fine, and the datafiles, etc. are all there.
> To post to this group, send email to mongodb-user@googlegroups.com.
> To unsubscribe from this group, send email to
> mongodb-user+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/mongodb-user?hl=en.
Ah, ok.
Can you send the full log?
Might be an issue with them all trying to initialize at the same
second and something odd happening.
Hard to tell without log.
> To post to this group, send email to mongodb-user@googlegroups.com.
> To unsubscribe from this group, send email to
> mongodb-user+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/mongodb-user?hl=en.
On Monday, 14 May 2012 00:34:40 UTC-4, Eliot Horowitz wrote:
> Ah, ok. > Can you send the full log? > Might be an issue with them all trying to initialize at the same > second and something odd happening. > Hard to tell without log.
To the list or you personally?
I rather doubt it is a timing issue (but what do I know?)
Consider that the snapshots applied to create the new RAID10 underneath the db has a different set of server names in it, and was taken from the secondary in a different deployment say, 24 hours earlier - hence the need to reconfig() - new server CNAMEs.
Perhaps this is an "odd" case one doesn't normally plan for :-)
If you can post the logs to the list (using something like pastebin<http://pastebin.com/>), that'd be best. If you aren't comfortable sharing your logs publicly, then you can create a ticket in 10gen's jira system (jira.mongodb.org) in the "Community Private" project and attach the logs there.
When you delete the local database files that should eliminate all references to the old server names.
Are you running rs.initiate() on all 3 nodes at the same time? If so, what happens if you only run initiate() on one?
On Tuesday, May 15, 2012 12:02:45 AM UTC-4, Michael wrote:
> On Monday, 14 May 2012 00:34:40 UTC-4, Eliot Horowitz wrote:
>> Ah, ok. >> Can you send the full log? >> Might be an issue with them all trying to initialize at the same >> second and something odd happening. >> Hard to tell without log.
> To the list or you personally?
> I rather doubt it is a timing issue (but what do I know?)
> Consider that the snapshots applied to create the new RAID10 underneath > the db has a different set of server names in it, and was taken from the > secondary in a different deployment say, 24 hours earlier - hence the need > to reconfig() - new server CNAMEs.
> Perhaps this is an "odd" case one doesn't normally plan for :-)
On Tuesday, 15 May 2012 11:52:17 UTC-4, Spencer T Brody wrote:
> If you can post the logs to the list (using something like pastebin<http://pastebin.com/>), > that'd be best. If you aren't comfortable sharing your logs publicly, then > you can create a ticket in 10gen's jira system (jira.mongodb.org) in the > "Community Private" project and attach the logs there.
> When you delete the local database files that should eliminate all > references to the old server names.
> Are you running rs.initiate() on all 3 nodes at the same time? If so, > what happens if you only run initiate() on one?
