Duplicate Collections!!!

188 views
Skip to first unread message

Reinaldo

unread,
Jan 13, 2011, 3:52:28 PM1/13/11
to mongodb-user
Hi there on our production cluster seems like we managed to get
multiple collections with the same name into it.

echo "show collections" | mongo mongo01:30000/
aa895ca8156f4c7fa4104b1b4c9a8c38 | wc -l
10346
echo "show collections" | mongo mongo01:30000/
aa895ca8156f4c7fa4104b1b4c9a8c38 |sort -u | wc -l
450


mongo01 is a mongos connected to a cluster of 2 replica sets of 3
members each.

aa895ca8156f4c7fa4104b1b4c9a8c38 is the database name that is having
issues.

the java driver seems to enumerate ok the databases though, but
rockmongo does show the 10k+ entries.


The only "strange" thing but should not be a problem is that these
collections are dropped and sometimes dropped while there are inserts
going on, but is my understanding that it should just recreate it and
start inserting the data

Adrien Mogenet

unread,
Jan 13, 2011, 5:32:12 PM1/13/11
to mongodb-user
Which version are you using ?

Did you launch any map/reduce job ?

Andreas Jung

unread,
Jan 14, 2011, 12:32:27 AM1/14/11
to mongod...@googlegroups.com
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

You were claiming that already on IRC last night but
you did not follow our recommenation writing some code for checking
the collection names through a small (non-Javascript) script/program.
Why not?

- -aj


- --
ZOPYX Limited | zopyx group
Charlottenstr. 37/1 | The full-service network for Zope & Plone
D-72070 T�bingen | Produce & Publish
www.zopyx.com | www.produce-and-publish.com
- ------------------------------------------------------------------------
E-Publishing, Python, Zope & Plone development, Consulting


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQGUBAEBAgAGBQJNL9/qAAoJEADcfz7u4AZjVmsLwLwhtoOxWKAHD0+D4sJgyIoo
OOhZ49xr2QBy6pGzMvFzgPTz8j9jRQRfpqGgPjRFpz8liq0V3qvDRsJgpVFDa0LH
fWRaQu9pU1tm8/PIDx7NUvcFS3ahZiZe0rkcleBTj/kawrkyqOet4rZjIMYEZ799
bAG+2SW64KpsLXo2kXpheKx4LaNK9smr4ri2BryuPtHzPGeQDgPKnJzEfD0LgQzT
PNW/tBRYk8iLOB/5lizY0RxEgYB7ZtAHgE+4nUpr39oRaCZsGtwQc1gOIoxxLPQi
UMk+hzYuiDtie0W6ZPDj6L8HB6UzIOjSNzLR0NH3RQWKIzcZOUsoJqBIO912fqUw
zOzakc6casLr+bPYTbd1eLA17q7OvFlRWOE2OpwwTOjrEfEFGCR8V3NVV12o5S1e
qb/dmLY8H43G5hxzofxKYAizGtV5aI8ebaw8FpBYDz6491kMVrGrxDxHqrpOFq+1
EVzemHEHMnoYCkln2bareusdXFM5vM4=
=GYMy
-----END PGP SIGNATURE-----

lists.vcf

Reinaldo

unread,
Jan 19, 2011, 1:48:17 PM1/19/11
to mongodb-user
I did write the program in java, it did not show the duplicate
collections.
running a db.repairDatabase() fixed the issue, the exceptions and the
duplicate collections.
The names on the collections did not have any hidden characters not
according to the shell or the java program.

Reinaldo.-
> D-72070 T�bingen        | Produce & Publishwww.zopyx.com          |www.produce-and-publish.com
> - ------------------------------------------------------------------------
> E-Publishing, Python, Zope & Plone development, Consulting
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.11 (Darwin)
> Comment: Using GnuPG with Mozilla -http://enigmail.mozdev.org/
>
> iQGUBAEBAgAGBQJNL9/qAAoJEADcfz7u4AZjVmsLwLwhtoOxWKAHD0+D4sJgyIoo
> OOhZ49xr2QBy6pGzMvFzgPTz8j9jRQRfpqGgPjRFpz8liq0V3qvDRsJgpVFDa0LH
> fWRaQu9pU1tm8/PIDx7NUvcFS3ahZiZe0rkcleBTj/kawrkyqOet4rZjIMYEZ799
> bAG+2SW64KpsLXo2kXpheKx4LaNK9smr4ri2BryuPtHzPGeQDgPKnJzEfD0LgQzT
> PNW/tBRYk8iLOB/5lizY0RxEgYB7ZtAHgE+4nUpr39oRaCZsGtwQc1gOIoxxLPQi
> UMk+hzYuiDtie0W6ZPDj6L8HB6UzIOjSNzLR0NH3RQWKIzcZOUsoJqBIO912fqUw
> zOzakc6casLr+bPYTbd1eLA17q7OvFlRWOE2OpwwTOjrEfEFGCR8V3NVV12o5S1e
> qb/dmLY8H43G5hxzofxKYAizGtV5aI8ebaw8FpBYDz6491kMVrGrxDxHqrpOFq+1
> EVzemHEHMnoYCkln2bareusdXFM5vM4=
> =GYMy
> -----END PGP SIGNATURE-----
>
>  lists.vcf
> < 1KViewDownload

Reinaldo

unread,
Jan 19, 2011, 1:50:10 PM1/19/11
to mongodb-user
I do indeed, every couple of minutes I do run a bunch of group
(which I think is a MR op anyways) Do you think that is the cause for
the duplicate collections ? In my setup something like this could
happen

1.- start a group op.
2.- collection gets dropped from another call
3.- inserts start happening so a new collection (with the same name)
gets created


Reinaldo

Eliot Horowitz

unread,
Jan 19, 2011, 1:56:53 PM1/19/11
to mongod...@googlegroups.com
Group is not map/reduce actually, so its unlikely to be the issue.
What version are you run?

> --
> You received this message because you are subscribed to the Google Groups "mongodb-user" group.
> To post to this group, send email to mongod...@googlegroups.com.
> To unsubscribe from this group, send email to mongodb-user...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
>
>

Reinaldo

unread,
Jan 19, 2011, 2:17:15 PM1/19/11
to mongodb-user
That cluster is running 1.6.3.

Reinaldo

On Jan 19, 10:56 am, Eliot Horowitz <eliothorow...@gmail.com> wrote:
> Group is not map/reduce actually, so its unlikely to be the issue.
> What version are you run?
>

Eliot Horowitz

unread,
Jan 19, 2011, 3:00:40 PM1/19/11
to mongod...@googlegroups.com
I would upgrade to 1.6.5 if possible.
Reply all
Reply to author
Forward
0 new messages