[Puppet - Bug #2860] (Accepted) Test isolation: spec/unit/application/puppetdoc.rb causes failures in spec/unit/parser/resource/reference.rb

[red...@reductivelabs.com]

Issue #2860 has been reported by Markus Roberts.

---

Bug #2860: Test isolation: spec/unit/application/puppetdoc.rb causes failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts
• Status: Accepted
• Priority: Low
• Assigned to: Jesse Wolfe
• Category: testing
• Target version: 0.25.2
• Affected version: 0.25.1
• Keywords:
• Branch:

Running spec/unit/application/puppetdoc.rb before spec/unit/parser/resource/reference.rb, e.g. with

touch spec/unit/application/puppetdoc.rb
    ruby spec/unit/application/puppetdoc.rb spec/unit/parser/resource/reference.rb -t 60 --format s --loadby mtime

Causes spurious failures:

- should canonize resource reference values (FAILED - #)

---

You have received this notification because you have either subscribed to it, or are involved in it.
To change your notification preferences, please click here: http://reductivelabs.com/redmine/my/account

[red...@reductivelabs.com]

Issue #2860 has been updated by Markus Roberts.

• Subject changed from Test isolation: spec/unit/application/puppetdoc.rb causes failures in spec/unit/parser/resource/reference.rb to Test isolation: sunrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

puppetdoc isn't special; any of the following (and perhaps others) have the same effect:

spec/unit/util/filetype.rb
spec/unit/parser/ast/function.rb
spec/unit/parser/ast/casestatement.rb
spec/integration/ssl/certificate_authority.rb
spec/unit/property/ordered_list.rb
spec/unit/parser/functions/sprintf.rb
spec/integration/file_serving/metadata.rb
spec/unit/ssl/certificate_authority.rb
spec/integration/indirector/catalog/compiler.rb
spec/unit/provider/user/ldap.rb
spec/unit/application/puppetdoc.rb
spec/unit/parser/functions/regsubst.rb
spec/unit/network/format_handler.rb
spec/unit/indirector/key/file.rb
spec/unit/parser/functions/split.rb
spec/unit/simple_graph.rb
spec/unit/provider/confine/exists.rb
spec/unit/ssl/key.rb
spec/shared_behaviours/memory_terminus.rb
spec/integration/util/file_locking.rb
spec/integration/node.rb
spec/integration/file_serving/content.rb
spec/integration/checksum.rb
spec/integration/type.rb
spec/unit/util/user_attr.rb
spec/unit/indirector/catalog/yaml.rb
spec/unit/provider/zpool/solaris.rb
spec/unit/type/zpool.rb
spec/unit/type/augeas.rb
spec/unit/indirector/terminus.rb
spec/unit/indirector/report/processor.rb
spec/unit/parser/functions/shellquote.rb
spec/unit/indirector/code.rb
spec/unit/file_serving/base.rb
spec/unit/node/environment.rb
spec/unit/reports.rb

---

Bug #2860: Test isolation: sunrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

[red...@reductivelabs.com]

Issue #2860 has been updated by Markus Roberts.

• Subject changed from Test isolation: sunrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb to Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb
• Assigned to changed from Jesse Wolfe to Markus Roberts

---

Bug #2860: Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts
• Status: Accepted
• Priority: Low

• Assigned to: Markus Roberts

• Category: testing
• Target version: 0.25.2
• Affected version: 0.25.1
• Keywords:
• Branch:

[red...@reductivelabs.com]

Issue #2860 has been updated by Markus Roberts.

• Target version changed from Puppet - 0.25.2 to Puppet - 0.25.3

I'm pushing this one out to 0.25.3 because it does not appear to be consistently reproducible (there appears to be some other confounding factor in addition to the ordering). I suspected it might have to do with the loading of libraries, but was unable to confirm this because after adding code to dump $" I was unable to reproduce it.

---

Bug #2860: Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts
• Status: Accepted
• Priority: Low

• Assigned to: Markus Roberts
• Category: testing

• Target version: 0.25.3

• Affected version: 0.25.1
• Keywords:
• Branch:

[red...@reductivelabs.com]

Issue #2860 has been updated by Markus Roberts.

Just reproduced this on Ubuntu as of b86decc0ea.

---

Bug #2860: Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts
• Status: Accepted
• Priority: Low

• Assigned to: Markus Roberts
• Category: testing
• Target version: 0.25.3

• Affected version: 0.25.1
• Keywords:
• Branch:

[red...@reductivelabs.com]

Issue #2860 has been updated by Markus Roberts.

• Status changed from Accepted to Duplicate

The problem (as Jesse discovered in fixing the re-opened #2675) was that field initialization was order-indeterminate, so the type (needed for type-specific canonization) was not always set before the title.

---

Bug #2860: Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts
• Status: Duplicate

• Priority: Low
• Assigned to: Markus Roberts
• Category: testing
• Target version: 0.25.3

• Affected version: 0.25.1
• Keywords:
• Branch:

[red...@reductivelabs.com]

Issue #2860 has been updated by James Turnbull.

• Target version changed from Puppet - 0.25.3 to Puppet - 0.25.2

---

Bug #2860: Test isolation: unrelated tests cause spurious failures in spec/unit/parser/resource/reference.rb

• Author: Markus Roberts

• Status: Duplicate
• Priority: Low
• Assigned to: Markus Roberts

• Category: testing
• Target version: 0.25.2
• Affected version: 0.25.1
• Keywords:
• Branch: