As Chris said, it’s just an estimate, not a hard limit. It’s impossible to give exact numbers because there are so many app- and site-specific variables.
Our QE team put together a test suite that simulates clients performing something resembling a typical workload, and then ran a lot of tests with various numbers of simulated users connecting to various numbers of sync gateways with various sizes of Couchbase Server clusters. Then they graded the tests against various performance metrics, such as the latency of a change pushed by one client being read by another client. From analyzing those we came up with the estimate of about 5,000 users per gateway before performance starts to suffer.
So the bad news is we can’t give exact answers about how many servers you’ll need. But the good news is that both the Sync Gateway and Couchbase Server are very easy to scale (you basically just plug in new nodes) so you can ramp up to meet demand without downtime.
(In the future we may have clearer guidance, as we get more experience with real-world installations. The sales engineers here have a complex Excel spreadsheet that they use for predicting scaling of new Couchbase Server installations, based on past experience. I imagine that something like that will be developed for the Sync Gateway.)
—Jens