How often is the downloadables crawler run?

[Tim Van Holder]

Hi,

My Downloadables (as received from the update center) are a few days out of date.

How often is the crawler run? Are the logs of the last run viewable?

Specifically, .NET 5 was released on Wednesday but I'm still only seeing 5.0-rc.2 as highest available version in the file as downloaded at Jenkins startup.

Running the crawler script locally does produce up to date info.

(I also had issues with plugins under hpi:run, but looking at Jira that is a general issue, not specific to my setup.)

[Tim Van Holder]

Partially answering my own question: looking at https://updates.jenkins.io/updates/ suggests that the last run was 2020-10-28, over two weeks ago.

That feels like a rather long gap between runs.

[Gavin Mogan]

https://github.com/jenkins-infra/crawler/blob/master/Jenkinsfile#L10

Looks like it's supposed to be run every 4 hours.

Sadly it's on the super locked down trusted Jenkins install. It might be worth moving it to the less locked down infra one so more of us can look into and monitor failures.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAKMi--CdC9Ri5aZ-3ANCQJ59pLPvm3i-cEion8iPQfjcv5uUCQ%40mail.gmail.com.

[Daniel Beck]

Usually it runs every four hours, but an infra change two weeks ago accidentally caused it to stop.

For posterity:

Someone changed the configured Jenkins URL to fix an issue with Jetty.

That caused https://github.com/jenkins-infra/pipeline-library/blob/376e4789fcfca012198fd2dccba7436db87b3a36/vars/infra.groovy#L8 to return false (an unnecessarily brittle line of code if I've ever seen one)

That caused https://github.com/jenkins-infra/crawler/blob/265a0740aed9538e8f9c6c23121ed41930ff98d2/Jenkinsfile#L10 to effectively disable periodic executions.

[Gavin Mogan]

Okay https://github.com/jenkins-infra/pipeline-library/pull/171 got merged last night

https://updates.jenkins.io/updates/ is now showing 11-14 so \o/ crawlers are back online

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-de...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAMo7PtJyy13DmtyXdtLSd78LgB1BjC-gztguX6Dsn0fK7oo7CQ%40mail.gmail.com.