[JIRA] (JENKINS-58635) New builds with DELTA quality gates fail immediately

14 views
Skip to first unread message

luebbe.opensource@gmail.com (JIRA)

unread,
Jul 24, 2019, 6:02:02 AM7/24/19
to jenkinsc...@googlegroups.com
Lübbe Onken created an issue
 
Jenkins / New Feature JENKINS-58635
New builds with DELTA quality gates fail immediately
Issue Type: New Feature New Feature
Assignee: Ulli Hafner
Components: warnings-ng-plugin
Created: 2019-07-24 10:01
Environment: Jenkins 2.187
warnings-ng 5.3.0
Priority: Minor Minor
Reporter: Lübbe Onken

We switched our pipeline job generator to use DELTA for the quality gates instead of NEW. Now every new build pipeline fails the first (and every following) build until we reset the quality gate. This didn't happen with jobs that were generated with NEW. Shouldn't a first build automatically be accepted as the reference build no matter how many DELTA/NEW issues are detected?

These are the final lines of the quality gate report (first build):
Evaluating quality gates
-> WARNING - Delta (any severity): 36 - Quality QualityGate: 1
-> FAILED - Delta of warnings (severity high): 1 - Quality QualityGate: 1
-> FAILED - Delta of warnings (severity normal): 6 - Quality QualityGate: 2
-> FAILED - Delta of warnings (severity low): 29 - Quality QualityGate: 4
-> Some quality gates have been missed: overall result is FAILED
Health report is disabled - skipping

Output of the quality gate report of a different branch created earlier with "NEW" instead of "DELTA":
Evaluating quality gates
-> PASSED - Number of new warnings (severity high): 0 - Quality QualityGate: 1
-> PASSED - Number of new warnings (severity low): 0 - Quality QualityGate: 4
-> PASSED - Number of new warnings (severity normal): 0 - Quality QualityGate: 2
-> PASSED - Number of new issues (any severity): 0 - Quality QualityGate: 1
-> All quality gates have been passed
Health report is disabled - skipping

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

luebbe.opensource@gmail.com (JIRA)

unread,
Jul 24, 2019, 6:03:02 AM7/24/19
to jenkinsc...@googlegroups.com
Lübbe Onken updated an issue
Change By: Lübbe Onken
We switched our pipeline job generator to use DELTA for the quality gates instead of NEW. Now every new build pipeline fails the first (and every following) build until we reset the quality gate. This didn't happen with jobs that were generated with NEW. Shouldn't a first build automatically be accepted as the reference build no matter how many DELTA/NEW issues are detected?

These are the final lines of the quality gate report (first build):
Evaluating quality gates
-> WARNING - Delta (any severity): 36 - Quality QualityGate: 1
-> FAILED - Delta of warnings (severity high): 1 - Quality QualityGate: 1
-> FAILED - Delta of warnings (severity normal): 6 - Quality QualityGate: 2
-> FAILED - Delta of warnings (severity low): 29 - Quality QualityGate: 4
-> Some quality gates have been missed: overall result is FAILED
Health report is disabled - skipping

Output of the quality gate report of a different branch created earlier with "NEW" instead of "DELTA":
Evaluating quality gates
-> PASSED - Number of new warnings (severity high): 0 - Quality QualityGate: 1
-> PASSED - Number of new warnings (severity low): 0 - Quality QualityGate: 4
-> PASSED - Number of new warnings (severity normal): 0 - Quality QualityGate: 2
-> PASSED - Number of new issues (any severity): 0 - Quality QualityGate: 1
-> All quality gates have been passed
Health report is disabled - skipping


The issues total is 36 in both cases: 29 low, 6 normal, 1 high

luebbe.opensource@gmail.com (JIRA)

unread,
Aug 20, 2019, 3:18:02 AM8/20/19
to jenkinsc...@googlegroups.com
Lübbe Onken updated an issue
Change By: Lübbe Onken
Issue Type: New Feature Bug

ullrich.hafner@gmail.com (JIRA)

unread,
Sep 7, 2019, 2:52:03 PM9/7/19
to jenkinsc...@googlegroups.com

ullrich.hafner@gmail.com (JIRA)

unread,
Sep 7, 2019, 2:52:03 PM9/7/19
to jenkinsc...@googlegroups.com
Ulli Hafner started work on Bug JENKINS-58635
 
Change By: Ulli Hafner
Status: Open In Progress

ullrich.hafner@gmail.com (JIRA)

unread,
Sep 8, 2019, 5:14:03 AM9/8/19
to jenkinsc...@googlegroups.com
Change By: Ulli Hafner
Status: In Progress Fixed but Unreleased
Resolution: Fixed

ullrich.hafner@gmail.com (JIRA)

unread,
Sep 28, 2019, 5:15:02 PM9/28/19
to jenkinsc...@googlegroups.com
Change By: Ulli Hafner
Status: Fixed but Unreleased Resolved
Released As: 6.1.0
This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages