Global Variable - GO CD

[nitesh...@gmail.com]

Hi,

is there any way we can use a lobal variable and use that variable in my GO pipe Material path - like TFS repo path

This is really urgent , and quick help will be very much appreciated. Thanks in advance  

Regards, Nitesh 

[Ashwanth Kumar]

You could use Parameters for that purpose. 

--
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/aee436d7-9c27-4005-9d35-070aed4e048an%40googlegroups.com.

[nitesh...@gmail.com]

Thanks ,

but i can't see any option to set parameter global to the environment , do we have any other option ?

i have got 100 pipes, where having same TFS path but dynamic change number, which needs to concatenated with TFS path   , so we want to execute 100 pipes in one for different -different change number on adhoc basis.

[Ashwanth Kumar]

IMHO, Environment in GoCD helps in grouping pipelines to provide environment related settings (via environment variables) or agents (that have environment specific access / configurations). A variable used in the pipeline's material isn't specific to an environment and also Parameters are specific to a pipeline. So much so, that when a pipeline is saved all the parameters that are referred within (either on config / jobs / stages) should be available else the config validation would fail and the new pipeline changes wouldn't get saved. 

For your current situation, I do have a few suggestions:

1. If you're creating the pipelines right now, I would recommend using the YAML / JSON DSL which would make your life easier. You can find and replace the values quickly. 

2. If these 100s of pipelines already exist, During an off-peak time / with maintenance mode enabled -- You can import the config.xml locally and find-replace the material path and import the new config back as a one time migration. 

Thanks,

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/80994bd0-3d71-4a8d-9bd6-a929c01bada3n%40googlegroups.com.

--

Ashwanth Kumar / ashwanthkumar.in

[nitesh...@gmail.com]

Thanks,

Yes, these pipeline already exists.

but updating the config XML every time when we will have new change from client will be risky.

request you to please help another way around ?

[Marques Lee]

I would just do what Ashwanth suggested with Environments: put your pipelines (and agents!) in the same environment and then you can apply these (e.g., environment variables) globally to all pipelines in that environment.

[Marques Lee]

Actually, nevermind on the environment variable - I don't think you can use those in materials, and you're wanting to use it there it seems. Using pipelines as code would really be the best option, IMO.

[Marques Lee]

But, since that's a lot of work and you need a solution in the immediate, I think your only option is to bulk-edit the config XML and do this with a good text editor.

[Nitesh Kumar]

Hi,

Thanks,  I can editing config.xml but doing everytime for each change number would be really horrible 😞 

Any other ideas?

It looks a wiered case that we can't use env variables in materials even my pipeline does exist in the same environment 

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/ff7c92b5-83f8-4a22-b013-a69657c95019n%40googlegroups.com.

[Marques Lee]

When the server needs to check a material in the flyweight directory to determine whether it should schedule pipelines, it doesn’t bind environment variables, most likely because environment variables are scoped to a single pipeline. On the other hand, materials aren’t necessarily unique to a pipeline. The same material can be used in other pipelines and contexts (eg, config repo) so the material service wouldn’t have defined behavior for other uses to bind environment variables, which are scoped to a single pipeline. At least that’s what I am inferring off the top of my head without digging into the code too much.

So, unfortunately, there’s no solution that is both quick and long-term that I’m an think of. The quick one is bulk editing your config xml. The long term is reimplementing in pipelines as code so that you can apply changes to multiple pipeline config a very easily.

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/CAKns_UmS4e4vEb%2BLvYhcMLy5QqNSxp_uFy5Bm%2BwGm%3D-WsBBmbg%40mail.gmail.com.

[Nitesh Kumar]

Thanks,

So, do we have any endpoint which updates the pipeline ?

Regards, Nitesh 

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/CAPKX9jZ3TSpMPf2ZCH0TxF8GwqV9Y7YVtNLDZ%3D%2BsA0KycDaBGg%40mail.gmail.com.

--

Thanks&Regards

Nitesh kumar

[Ashwanth Kumar]

You can check the GoCD APIs online at https://api.gocd.org/ (against the corresponding version of your GoCD Server).

If you're planning to automate your way through, https://github.com/gocd-contrib/gomatic might be of your interest. 

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/CAKns_Un-5L9Ahe7wXRV3ch1PubGptBYhK%2BQEnL4EKh6DKnwZ6w%40mail.gmail.com.

[Nitesh Kumar]

Thanks,

Yes, i am planning to automate and to update materials before executing my pipes.

i have gone through the APIs but i can't find any endpoint which updates the pipeline, do we have any?

To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/CAD9m7Cx8b80M6uDb3KymCcLGS_-W3FkzQMyQ719Y8HkeA%2BP1-w%40mail.gmail.com.

--

Thanks&Regards

Nitesh kumar

[Nitesh Kumar]

HI  Ashwanth,

Do we have any API open which updates the Project path of the material ? I have searched in the GOCD API section but i can't find it.

Request you to please help on this.

Regards, Nitesh 

--

Thanks&Regards

Nitesh kumar

[Aravind SV]

Materials are part of a pipeline and so, they are updated using the “Edit pipeline config” API call: https://api.gocd.org/current/#edit-pipeline-config

You’ll need to do a GET and then a PUT with an If-Match header based on the GET response: https://developer.mozilla.org/en-US/docs/Web/HTTP/Conditional_requests

[Nitesh Kumar]

Hi Aravind,

i have tried editing pipeline config using PUT method and i am sending the Json on the basis of output i had using GETmethod for one pipeline but it is throwing an error while validating Json. below is the command i am using

$putResponse = D:\temp\curl.exe  -X PUT -u 'test:****' -H 'Accept: application/vnd.go.cd.v4+json' -H 'Content-Type: application/json' -H 'If-Match: "********"' 'http://********:8153/go/api/admin/pipelines/testpipe' -d $text

Request you to please help on this.

Regards, Nitesh 

On Mon, Jan 11, 2021 at 4:51 PM Aravind SV <aven...@thoughtworks.com> wrote:

Materials are part of a pipeline and so, they are updated using the “Edit pipeline config” API call: https://api.gocd.org/current/#edit-pipeline-config

You’ll need to do a GET and then a PUT with an If-Match header based on the GET response: https://developer.mozilla.org/en-US/docs/Web/HTTP/Conditional_requests

--

Thanks&Regards

Nitesh kumar

[Aravind SV]

I’d suggest doing a GET and then makee no change and do a PUT. That should work. If it doesn’t, you probably have some of the parameters wrong in your request.