Benchmarking and Performance criteria for Couchbase lite iOS version

[Ashvinder Singh]

Hello All, 

I’m trying to come up with a criteria for doing benchmarking and performance testing for Couchbase Lite iOS version and needed your help. Essentially trying to find the limits of the database and how does the database behave in extreme edge cases. 

At present I have:

• How many documents (small size ~ few MB) can be created in couchbase lite 
• How much time a query (exact queries, key ranges, etc) takes to execute if we have large (10K) documents of small size

So what other things I should add to the above list which are important and provide a good indication of limits/boundaries in the database?

Thanks,

Ashvinder 

[Andrew Reslan]

Ashvinder

Hi, for your query tests on large document sets, I would suggest adding tests for queries against views that have a reduce block as well as a map block, I think I'm right in saying that the reduce block results are not persisted so must be re-calculated for each query execution.

Also tests for a single database with concurrent access from application threads and push/pull sync.

Andy

[Matt Quinn]

Hi Ashvinder,

Replication speed is another important one, especially pull replications from a source database (Sync Gateway, CouchDB, etc.). Our use case for example relies on completing a pull of existing data before the app is really usable, so the faster that initial replication, the better.

Also, an issue related to query time is the time it takes to index views, from scratch or incrementally following a document update.

Cheers,
Matt

Ashvinder Singh <ashvind...@gmail.com> wrote:
>
>
>Hello All,
>
>I’m trying to come up with a criteria for doing benchmarking and
>performance testing for Couchbase Lite iOS version and needed your
>help.
>Essentially trying to find the limits of the database and how does the
>database behave in extreme edge cases.
>
>At present I have:
>

>- How many documents (small size ~ few MB) can be created in couchbase
> lite
> - How much time a query (exact queries, key ranges, etc) takes to

[Ashvinder Singh]

Good Idea Matt, thanks!

[Ashvinder Singh]

Thanks Andy, I will definitely add these.

[Traun Leyden]

Here is a recent issue filed by a user regarding Couchbase Lite Android performance:

https://github.com/couchbase/couchbase-lite-android/issues/166#issuecomment-32468005

--
You received this message because you are subscribed to the Google Groups "Couchbase Mobile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mobile-couchba...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mobile-couchbase/57e548b8-67f9-4737-b777-ba81bcf88f3e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Ashvinder Singh]

Thanks Traun, I will add these tests and try to replicate the results on both the platforms.