Jira (FACT-2813) Show backtrace in CI for acceptance test errors

46 views
Skip to first unread message

Bogdan Irimie (Jira)

unread,
Sep 24, 2020, 11:32:04 AM9/24/20
to puppe...@googlegroups.com
Bogdan Irimie created an issue
 
Facter / Task FACT-2813
Show backtrace in CI for acceptance test errors
Issue Type: Task Task
Assignee: Unassigned
Created: 2020/09/24 8:31 AM
Priority: Normal Normal
Reporter: Bogdan Irimie

Check if backtrace is shows in GithuHub actions acceptance test and in Jenkins acceptance test. If the backtrace is printed only partially, print it all.

Acceptance criteria:

  • backtrace is printed in all acceptance CI jobs.
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
Atlassian logo

Andrei Filipovici (Jira)

unread,
Sep 24, 2020, 11:58:03 AM9/24/20
to puppe...@googlegroups.com
Andrei Filipovici updated an issue
Change By: Andrei Filipovici
Check if backtrace is shows shown in GithuHub failed GitHub actions acceptance test and in Jenkins acceptance test tests . If the backtrace is printed only partially, print it all.
 Example from a failed Jenkins test:

08:37:53       system_uptime => {
08:37:53         days => 0,
08:37:53         hours => 2,
08:37:53         seconds => 9676,
08:37:53         uptime => "2:41 hours"
08:37:53       }
08:37:53       timezone => UTC
08:37:53       virtual => vmware
08:37:53     
08:37:53     akin-complement.delivery.puppetlabs.net (akin-complement.delivery.puppetlabs.net) executed in 0.60 seconds
08:37:53 Minitest::Assertion: Expected no errors from facter when run as user nonroot.
08:37:53 Expected "[2020-09-18 05:37:53.249985 ] ERROR Facter::InternalFactManager - \e[31mPermission denied @ dir_initialize - /var/lib/NetworkManager\e[0m\n " to be empty.
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/minitest-5.14.2/lib/minitest/assertions.rb:183
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/minitest-5.14.2/lib/minitest/assertions.rb:198
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:28
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/helpers/host_helpers.rb:93
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/shared/host_manager.rb:130
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/patterns.rb:37
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/helpers/host_helpers.rb:63
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:27
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/structure.rb:44
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/logger.rb:239
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/structure.rb:43
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:26
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:14
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:14
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/structure.rb:124
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/logger.rb:239
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/dsl/structure.rb:123
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/tests/facts/non_root_users_without_errors.rb:1
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_case.rb:133
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_case.rb:133
08:37:53 /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/2.5.0/benchmark.rb:308
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_case.rb:130
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_suite.rb:66
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_suite.rb:63
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_suite.rb:63
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/test_suite.rb:115
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/cli.rb:192
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/cli.rb:118
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/lib/beaker/subcommand.rb:199
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/thor-1.0.1/lib/thor/command.rb:27
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/thor-1.0.1/lib/thor/invocation.rb:127
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/thor-1.0.1/lib/thor.rb:392
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/thor-1.0.1/lib/thor/base.rb:485
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/gems/beaker-4.27.0/bin/beaker:7
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/bin/beaker:23
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/bin/beaker:23
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/bin/ruby_executable_hooks:24
08:37:53 /tmp/jenkins/workspace/platform_puppet-agent_puppet-agent-integration-suite_daily-main/RMM_COMPONENT_TO_TEST_NAME/facter/SLAVE_LABEL/beaker/TEST_TARGET/fedora32-64a/acceptance/.bundle/gems/ruby/2.5.0/bin/ruby_executable_hooks:24
08:37:53 Begin teardown
08:37:53

Facter.to_hash is called and an exception is raised, but we don't have the entire backtrace to know from where the error was raised and what it was exactly.

 Acceptance criteria:
- full backtrace is printed in all acceptance CI jobs.

Bogdan Irimie (Jira)

unread,
Sep 30, 2020, 9:46:04 AM9/30/20
to puppe...@googlegroups.com
Bogdan Irimie commented on Task FACT-2813
 
Re: Show backtrace in CI for acceptance test errors

If we encounter an error, we should display the stack trace.

Bogdan Irimie (Jira)

unread,
Sep 30, 2020, 9:54:04 AM9/30/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
 
Change By: Bogdan Irimie
Story Points: 1

Bogdan Irimie (Jira)

unread,
Sep 30, 2020, 9:54:04 AM9/30/20
to puppe...@googlegroups.com
 
Re: Show backtrace in CI for acceptance test errors

Investigate if adding --trace on facter helps.

Bogdan Irimie (Jira)

unread,
Sep 30, 2020, 9:54:04 AM9/30/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ready for triage ghost-7.10

Bogdan Irimie (Jira)

unread,
Oct 7, 2020, 9:05:04 AM10/7/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10 , ready for triage 2

Bogdan Irimie (Jira)

unread,
Oct 14, 2020, 10:04:03 AM10/14/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10 , ready for triage 2

Andrei Filipovici (Jira)

unread,
Oct 21, 2020, 2:34:03 AM10/21/20
to puppe...@googlegroups.com
Andrei Filipovici assigned an issue to Andrei Filipovici
Change By: Andrei Filipovici
Assignee: Andrei Filipovici

Bogdan Irimie (Jira)

unread,
Oct 21, 2020, 9:13:09 AM10/21/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10 , PR - Triage 2

Bogdan Irimie (Jira)

unread,
Oct 28, 2020, 10:10:03 AM10/28/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10 , PR - Triage 2

Bogdan Irimie (Jira)

unread,
Nov 4, 2020, 9:11:03 AM11/4/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10, ghost-4.11 , PR - Triage 2

Bogdan Irimie (Jira)

unread,
Nov 18, 2020, 8:50:03 AM11/18/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10, ghost-4.11, ghost-11.11 , ready for triage 2

Bogdan Irimie (Jira)

unread,
Nov 25, 2020, 9:04:05 AM11/25/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10, ghost-4.11, ghost-11.11, ghost 25.11 , ready for triage 2

Bogdan Irimie (Jira)

unread,
Dec 2, 2020, 2:40:04 AM12/2/20
to puppe...@googlegroups.com
Bogdan Irimie updated an issue
Change By: Bogdan Irimie
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10, ghost-4.11, ghost-11.11, ghost 25.11, ghost-2.12 , ready for triage 2

Josh Cooper (Jira)

unread,
Jan 28, 2021, 5:59:03 PM1/28/21
to puppe...@googlegroups.com
Josh Cooper updated an issue
Change By: Josh Cooper
Fix Version/s: FACT 4.0.50

Ciprian Badescu (Jira)

unread,
Feb 4, 2021, 5:41:10 AM2/4/21
to puppe...@googlegroups.com
Ciprian Badescu updated an issue
Change By: Ciprian Badescu
Fix Version/s: FACT 4.0.50

Oana Tanasoiu (Jira)

unread,
Jul 14, 2021, 3:15:03 AM7/14/21
to puppe...@googlegroups.com
Oana Tanasoiu updated an issue
Change By: Oana Tanasoiu
Sprint: ghost-7.10, ghost-14.10, ghost-21.10, ghost-28.10, ghost-4.11, ghost-11.11, ghost 25.11, ghost-2.12 , ready for triage 2
This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97)
Atlassian logo

Andrei Filipovici (Jira)

unread,
Sep 7, 2021, 5:02:03 AM9/7/21
to puppe...@googlegroups.com
Andrei Filipovici commented on Task FACT-2813
 
Re: Show backtrace in CI for acceptance test errors

Beaker wasn't adding to the trace stdout and stderr of the commands it was running, when it run on localhost. PR https://github.com/voxpupuli/beaker/pull/1691, fixed this.
Reply all
Reply to author
Forward
0 new messages