Fetching multiple materials

730 views
Skip to first unread message

Michael Maley

unread,
Feb 10, 2015, 3:53:39 PM2/10/15
to go...@googlegroups.com
I have Pipeline A with [x] Automatic pipeline scheduling and 3 TFS materials. The first material has [x] Poll for new changes, the others do not. The first stage is Build-All with [x] Fetch materials and [x] Clean working directory. The stage has 3 jobs to build each of the materials respectively. However, the jobs tied to the [] Poll materials do *NOT* check out the latest source code. Am I missing something? I could factor those jobs into separate pipelines, but I don't want to enable Poll for new changes, so I suspect the same behavior would happen.

Thank you in advance for your help.

Thanks,
Michael Maley

srinivas upadhya

unread,
Feb 10, 2015, 10:30:10 PM2/10/15
to Michael Maley, go...@googlegroups.com

this thread should help you - https://groups.google.com/forum/m/#!searchin/go-cd/ignore$20pattern/go-cd/rBouLywo3a4

srinivas upadhya

unread,
Feb 10, 2015, 11:35:48 PM2/10/15
to Michael Maley, go...@googlegroups.com
For some reason the link does not work. Here is the link for the thread - https://groups.google.com/d/topic/go-cd/rBouLywo3a4/discussion

Also, "The stage has 3 jobs to build each of the materials respectively." - Almost always means they should be separate pipelines.

Michael Maley

unread,
Feb 11, 2015, 12:32:24 PM2/11/15
to go...@googlegroups.com, michae...@gmail.com
That makes sense. Set [x] Poll for new changes, but blacklist itself. However, I can't get the blacklist to work. I have tried A/B/**/* and $/A/B/**/* per the documentation. Any suggestions.

Thanks! 

Michael Maley

unread,
Feb 11, 2015, 4:52:15 PM2/11/15
to go...@googlegroups.com, michae...@gmail.com
Any documentation on TFS blacklist paths?
 
I can rephrase my use case. I have pipeline A that has two materials 1 ([x] Poll for new changes) and 2 ([] Poll). The first stage is Build with [x] Fetch materials and [x] Clean working directory. The job runs msbuild. The first material is the main VS solution folder and material 2 is the peer, common source code folder. So I only want to poll on VS solution changes, but I need two check outs to recreate the partial source code tree. Whether or not this is good source code structure is moot, since it is my circumstances. As stands, Go doesn't check out the latest of material 2 unless I wait quite a bit. I suspect this has something to do with (from the online docs):
  • In this release, Go does not delete any workspace it has created. Workspace names are generated internally.
  • Currently, Go always does a tfs get to retrieve the latest changes on the agents.
My coworker told me this is the problem. The workspace is not being forced to refresh itself, so it might not necessarily be the latest. I don't see how [x] Poll for new changes somehow forces the latest. Sounds like some extra stuff is going on in the background tied to that option. If [x] Poll and Blacklist is some kind of workaround, that is fine, just need that to work.

Thanks in advance!

Michael Maley

unread,
Feb 11, 2015, 6:05:38 PM2/11/15
to go...@googlegroups.com, michae...@gmail.com
Got the blacklist working with a simple "/**/*" pattern. However, [x] Poll for new changes plus /**/* didn't resolve my issue. Still didn't pull the latest of material 2.

Md. Ali Ejaz

unread,
Feb 12, 2015, 6:24:29 AM2/12/15
to Michael Maley, go...@googlegroups.com
As stands, Go doesn't check out the latest of material 2 unless I wait quite a bit.

 Got the blacklist working with a simple "/**/*" pattern. However, [x] Poll for new changes plus /**/* didn't resolve my issue. Still didn't pull the latest of material 2.

Do you mean Go didn't reflect the changes at all? Or were the changes coming in a bit delayed?
Go has a system environment "material.update.idle.interval" with the default value of one minute. What it means is Go's polling interval is set to 1 minute by default. If the delay is due to this polling interval and you want the polling frequency to be increased you can override the value to the desired interval through Go_SERVER_SYSTEM_PROPERTIES.

--
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+un...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
- Ali
@mdaliejaz

Md. Ali Ejaz

unread,
Feb 12, 2015, 6:28:40 AM2/12/15
to Michael Maley, go...@googlegroups.com
You might sometime see the polling interval to be a little more than 1 minute. This could happen if the material update was happening for a material 'x' when the check for that material happened (start of new polling interval). The material would be skipped (even if the previous material update ended in the very next minute after the check) until the next polling cycle begins, thus increasing the interval further.
--
- Ali
@mdaliejaz

Michael Maley

unread,
Feb 12, 2015, 2:58:55 PM2/12/15
to go...@googlegroups.com
The changes came in a bit delayed, i.e. waited a few minutes and manually triggered the pipeline. Additionally, today, after a server reboot, am seeing the problem less.


Thanks!

Christopher Dean

unread,
Nov 27, 2024, 9:06:32 PM11/27/24
to go-cd
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING.


SHOP BELOW

Buy discounted welders, plasma cutters and welding safety gear by premium brands like Miller, Lincoln Electric, Hypertherm, Hobart and Black Stallion - from the mouse with over 86 years of welding experience.

where to order welding machines and accessories online with safe shipping.

we have the best welding tools like reels,miller remote,pipe bender,welding cable, lincoln rods,leads,miller welding helmet,mig guns,tig torches,plasma torches,welding cables,mig welders,tig welders,Etc.

Order now from our website below with safe and guaranteed shipping

Reply all
Reply to author
Forward
0 new messages