GoCD YAML configuration in source control

[Tomasz Sętkowski]

Hi all,

For those of you following progress on configuration repositories - I have just finished working on first release of YAML plugin. It can be downloaded from releases page at https://github.com/tomzo/gocd-yaml-config-plugin

If you don't know what is a configuration repository, see this introducing document.

Cheers,

Tom

[Ken Mugrage]

Hello,

Is there a specific naming convention the yaml files need to be in order to be picked up? (The sample repo isn't publicly available).

Thanks!

Ken

--
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+un...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Ken Mugrage - ThoughtWorkskmug...@thoughtworks.com+1(425) 835-3056@kmugrage

[Tomasz Sętkowski]

Hi Ken,

Thanks for trying out the plugin. The default pattern is any file that ends with .gocd.yaml ; Sorry about the missing example, I just pushed a verified, working repository to https://github.com/tomzo/gocd-yaml-config-example

Regards,

Tom

[David Rice]

Tom - 

Amazing work on the config in repository feature! I'm so happy to finally see it in GoCD.

If anyone wants to quickly play around with config in repositories, I've got a very simple fan-in demo:

  <config-repos>
    <config-repo plugin="json.config.plugin">
      <git url="https://github.com/djrice/gocd_sandbox_adder" />
    </config-repo>
    <config-repo plugin="json.config.plugin">
      <git url="https://github.com/djrice/gocd_sandbox_multiplier" />
    </config-repo>
    <config-repo plugin="json.config.plugin">
      <git url="https://github.com/djrice/gocd_sandbox_calculator" />
    </config-repo>
  </config-repos>

And if you don't want to deal with installing the latest version of Go to try it out and don't mind a docker setup, you can take a look at https://github.com/djrice/gocd_sanbox to quickly get going with this example (as well as golang agents).

-David

[Ken Mugrage]

Thanks Tom, and thanks for all the great work!

[René Perschon]

Hi Tom!

I'm trying to get your plugin to work in a dockerized gocd-server, however my git repo is not imported and i can't see any logs hinting at a problem. Can you give me a hint on how to find the problem? I'm using the gocd/gocd-server image from here https://hub.docker.com/r/gocd/gocd-server/ .

[Tomasz Sętkowski]

Hi René,

Docker or no-docker it should not matter. You most likely have bad configuration. Can you post <config-repos> section of your GoCD XML? Also note that your git config repository must have files ending with .gocd.yaml. Can you post one of those files too?

Regards,
Tom

--
You received this message because you are subscribed to a topic in the Google Groups "go-cd" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/go-cd/bAFYdWOQLEs/unsubscribe.
To unsubscribe from this group and all its topics, send an email to go-cd+un...@googlegroups.com.

[René Perschon]

Sure!

Here's my server config:

<?xml version="1.0" encoding="utf-8"?>

<cruise xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="cruise-config.xsd" schemaVersion="84">

  <server artifactsdir="artifacts" agentAutoRegisterKey="123456789abcdef" commandRepositoryLocation="default" serverId="03ca58da-7be3-459d-b208-057a0e2c344c" />

  <config-repos>

    <config-repo plugin="yaml.config.plugin">

      <git url="https://gitlab.com/leopard2a5-knorke/local-gocd.git" />

    </config-repo>

  </config-repos>

</cruise>

And here's my pipeline file (result-flow.gocd.yml):

---

pipelines:

  "result-flow":

    group: testgroup

    materials:

      mygit:

        git: https://github.com/Leopard2A5/result-flow.git

    stages:

      - build:

          jobs:

            build:

              tasks:

                - exec:

                    command: mvn clean compile

            test:

              tasks:

                - exec:

                    command: mvn test

I also have a simple.gocd.yaml pipeline file in the repository, it's one of the examples from your github.

[Tomasz Sętkowski]

Your configurations look correct. Having simple.gocd.yaml is a good idea too, because it is a part of tests. I can't tell why you cannot see pipelines on dashboard. Can you check these:
1. Is yaml configuration plugin visible in Admin->Plugins tab?
2. Are server health messages empty?
3. If it is, then try restarting server and grep logs for "leopard2a5-knorke/local-gocd" - it should cover any MDU errors or configuration repository, which are usually the only problem.

Also, you are using gitlab and https. Make sure that GoCD server can clone that project. You can try making it public on gitlab temporarily.
If Go cannot clone it, it will be in the logs.

Let me know if that helps, otherwise new server+plugin might be broken, I haven't updated in a while.

[René Perschon]

Hi Tom!

1. yes the plugin is there

2. I've seen a health message pop up today, and it vanished before i was able to read the whole text (boooo!)

3. no log messages of any help

but just reading part of the health message was enough, the server wasn't able to clone the repository due to restrictions on the repo itself. So thanks for your help!

[Tomasz Sętkowski]

Hi,

Please use the dedicated gitter channel for discussing issues and usage of YAML or JSON configuration repositories. 

Cheers,

Tom

[Michael Roepke]

Ho Tomzo,

do you still maintain and improve your go-cookbook github project?

Thanks for a response+

Cheers

Michael

[Tomasz Sętkowski]

Hi,

I do. I also use it personally with a wrapper cookbook so I keep gocd cookbook operational.
Currently Varsha V. is working on few improvements.

Cheers,
Tom

--

[nick....@tvnz.co.nz]

Hi Tom,

Do the files need to be in the repository root or can they be stored in a sub-directory?

Thanks,

Nick

[Aravind SV]

You should be able to change the file pattern in the plugin settings. I think it defaults to *.gocd.yaml. Maybe this works? "subdirectory/*.gocd.yaml". Haven't tried it.

The best place to ask questions about those plugins is probably here: https://gitter.im/gocd/configrepo-plugins/

Cheers,

Aravind

[venkatanathen kannan]

HI, 

I'm kind of stuck. 

I've added the below script

    <config-repo pluginId="yaml.config.plugin" id="aws-module-vpc">
      <git url="http://git.venkatkannan.com/aws-module-vpc.git" />
    </config-repo>

By adding above, will that create a pipeline automatically ?

how to refer the appropriate branch?

Thanks,

VK

[Aravind SV]

Hello!

https://gitter.im/gocd/configrepo-plugins might be a good place to ask questions about the YAML and JSON config plugins.

Cheers,
Aravind