Only 100 documents returned when syncing bucket created through bucket shadowing

[Jade Thorpe]

My team has been messing around with sync gateway for a while.  When bucket shadowing functionality came along in the Beta 3 release we were very excited.  We wanted to leverage an existing couchbase bucket that was full of data loaded using the couchbase APIs.    Everything seemed to work great, all the data mirrored from "bucket_source" to "bucket_shadow".  Yippeee!   However, when we tried to sync our mobile app (which is built using phonegap and cblite) we could only retrieve the first 100 documents.

We didn't know if it was our sync_gateway, the data or the mobile side setup that was causing the issue, SO we loaded the same data directly into another bucket using the sync_gateway REST interface.   Everything else remaining the same, we just changed the bucket name that we connect to.....we were able to sync all documents.

Why the 100 doc limit when we loaded the data using bucket shadowing?  I would expect that if we screwed something up somewhere it wouldn't work at all.  But why 100 docs?   When we sync with the other bucket that was loaded with REST interface everything works as expected.

Thanks in advance for your thoughts,

Jade

[Jens Alfke]

On May 9, 2014, at 2:26 PM, Jade Thorpe <jade....@gmail.com> wrote:

Everything seemed to work great, all the data mirrored from "bucket_source" to "bucket_shadow".  Yippeee!   However, when we tried to sync our mobile app (which is built using phonegap and cblite) we could only retrieve the first 100 documents.

That’s weird. There’s no such limit in the code.

Are there only 100 documents in the gateway’s internal bucket? (You can use the Couchbase Server admin UI to look.) I mean, other than the internal metadata documents whose IDs start with “_sync:”.

Also, what’s the latest version of sync_gateway you’ve used? Hopefully you at least upgraded to beta 3.1, as beta 3 had some issues.

—Jens

[Jade Thorpe]

VERSION.TXT says:   1.0-41

And response from sync_gateway is:   {"ADMIN":true,"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":"0.94"}

I installed from debian package:  couchbase-sync-gateway-community_1.0-beta3.1_x86_64.deb

There are 1.3 million records in the DB. 

Thanks,

Jade