Small RavenDB nodes in Kubernetes

[Mario Z.]

Hi RavenDB-Team

We are currently moving our infrastructure to Azure Kubernetes Services and are evaluating our RavenDB Pod setup.

Currently, we are using an Infrastructure as a Service environment where we have RavenDB nodes running on Linux. Consider the following:

• Several dozens of customers 
• The software consists of several modules which can be activated independently with a database per module (isolated from other customers and other modules)
• 10 - 500'000 documents (avg. 10'000) in each database
• Most databases are idle as it isn't a high traffic application with few concurrent users

These ≈500 databases are currently shared between 3 RavenDB nodes (no cluster). For AKS we are considering having one RavenDB Pod for each customer as every customer also gets their own API and frontend Pod. This way all the customer related data and traffic can be easily isolated. Additionally, we think about setting resource limits of 1 vCPU and 1GB - 2GB of RAM for our low traffic customers. The customers known to have higher traffic will get more resources.

Is such a resource constrained RavenDB setup reasonable or is it likely that RavenDB will crash the pod due to its limited (memory) resources? What would be your recommendation for our situation in a Kubernetes environment?

Thanks for your help!

Best regards,

Mario

[Georgios Diamantopoulos]

Very interested to know too! But wouldnt a quick load test convince us, Mario?

[Oren Eini (Ayende Rahien)]

Having such a system would work, yes. Given the load you are describing, a single pod should be sufficient. However, what about HA / backups / etc? 

You'll likely need to consider that scenario as well

--
You received this message because you are subscribed to the Google Groups "RavenDB - an awesome database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ravendb/238c5d9b-8d1a-403d-bb7a-2e834746fa01n%40googlegroups.com.

--

Oren Eini CEO   /   Hibernating Rhinos LTD Mobile:  972-52-548-6969 Sales:  sa...@ravendb.net Skype:  ayenderahien Support:  sup...@ravendb.net

[georgiosd]

Right. So I guess a constrained 3-node cluster is minimum for production.

[Oren Eini (Ayende Rahien)]

That is the general recommendation, yes

To view this discussion on the web visit https://groups.google.com/d/msgid/ravendb/8e5c684d-5046-49f3-bdf2-b62fab394048n%40googlegroups.com.

[Mario Z.]

Thanks for your response(s)!

We've done some (very) quick load testing which went well. For our production environment we'll definitely do some more though. We were mainly curious to hear if RavenDB should be able to work in the described environment so we can invest more time towards this approach.

At the moment we can live without HA. How we configure the backups is still an open question. Is there a way to configure (Server Wide) Tasks with the RavenDB CLI or other configuration methods? I couldn't find anything in the documentation.

[Oren Eini (Ayende Rahien)]

You can configure server wide backups, yes. There is REST API for that that you can use, but using the client API is probably easier

PUT /admin/configuration/server-wide/backup

Passing this object:

https://github.com/ravendb/ravendb/blob/9fc2c4471ebd520dd279e7edb95876d2cd115fbb/src/Raven.Client/ServerWide/Operations/Configuration/ServerWideBackupConfiguration.cs#L7

Via API:

var result = await store.Maintenance.Server.SendAsync(new PutServerWideBackupConfigurationOperation(new ServerWideBackupConfiguration
{
    FullBackupFrequency = "0 2 * * 0",
    AzureSettings = new AzureSettings()
    {
        AccountKey = "q",
        AccountName = "w",
        RemoteFolderName = string.Empty,
        StorageContainer = "322"
    },
    FtpSettings = new FtpSettings()
    {
        Url = string.Empty,
    },
    GlacierSettings = new GlacierSettings()
    {
        RemoteFolderName = string.Empty,
        AwsAccessKey = "q",
        AwsSecretKey = "w"
    },
    GoogleCloudSettings = new GoogleCloudSettings()
    {
        RemoteFolderName = string.Empty,
        BucketName = "b",
        GoogleCredentialsJson = "{}"
    },
    S3Settings = new S3Settings()
    {
        RemoteFolderName = string.Empty,
        AwsAccessKey = "q",
        AwsSecretKey = "w"
    }
}));

To view this discussion on the web visit https://groups.google.com/d/msgid/ravendb/5286b31b-9fa0-471d-a429-f26ab1517726n%40googlegroups.com.

[Mario Z.]

Perfect! Thanks a lot for your help!