limit of the number of agents

[f.fang]

Hello,

We need at least 500 agents to run distributed tests and are wondering if a GoCD server can handle well. Does anyone have experience of running GoCD at similar or larger scale?

[Sriram Narayanan]

On Fri, 4 Feb 2022 at 7:34 AM, f.fang <ff...@imvu.com> wrote:

Hello,

We need at least 500 agents to run distributed tests and are wondering if a GoCD server can handle well. Does anyone have experience of running GoCD at similar or larger scale?

Yes indeed. You will need to consider the CPU and memory capacity for the GoCD server process, the OS configuration ( are there Security or other seeing that would limit file handles, for eg), and strongly consider using a Postgres database instead of the in-memory H2DB.

To test, you can definitely explore scale via elastic agents. There is a feature to run a particular job on an N number of instances. You could validate your sizing requirements via that.

Something interesting for you to consider: GoCD makes the agent check out code or fetch an artifact from a job in an earlier stage. You would want to check if your source code server would permit a large number of clients connecting to it. Likewise, depending upon the artifacts size, you may want to review the network saturation on the GoCD server when it serves the artifacts to the agents and decide whether you want to serve the actual artifacts, or a textfile-based reference to that artifacts which the agent would then fetch from. For eg, for my large builds where I have large images as artifacts, I store the actual files elsewhere and only a reference to it within GoCD.

Let us know if you’d like us to expand on the above as you begin your proof of concept.

— Ram 

--
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/9990e46c-34e5-4698-a91d-3e0661d96193n%40googlegroups.com.