Jmeter test ignores assume_success property

[Fabrizio Capobianco]

Hello,

in our JMX we have the following setting as true:

<boolProp name="Assertion.assume_success">true</boolProp>

What Jmeter does, in this case, is ignoring the code returned by the server and only check the condition set. So if the server answers with 402 or 403, the check is marked as success, if the condition is met.

RedLine ignores this setting, and marks all 402 or 403 as errors.

For example:

<ResponseAssertion guiclass="AssertionGui" testclass="ResponseAssertion" testname="Check Response Code" enabled="true">
  <collectionProp name="Asserion.test_strings">
   <stringProp name="-1447182356">200|402</stringProp>
  </collectionProp>
  <stringProp name="Assertion.custom_message"></stringProp>
  <stringProp name="Assertion.test_field">Assertion.response_code</stringProp>
   <boolProp name="Assertion.assume_success">true</boolProp>
  <intProp name="Assertion.test_type">1</intProp>
</ResponseAssertion>

It means success if the code is 200 or 402. 

If Assertion.assume_success is set to false, 200 will be considered a success, but 402 will always be considered an error (as it is currently with Redline).

We are using Jmeter 4.0 as a setting for the test. Test 67395 should show you the behavior.

I believe the assume_success property is ignored in your code.

Best,

   fabrizio

[Richard Friedman]

Hi Fabrizio,

You are correct we look for one of three conditions to consider the request an error 

- Does the JMeter Sampler report failure

- OR is the error code between 0 and 200

- OR is the error code greater than 399

This was pretty old and related to how other test types work.  Thanks for calling this out.  We updated

the check to only be looking for the success flag, which will be specific to JMeter results and assertions. 

Thanks

RedLine13 

--
You received this message because you are subscribed to the Google Groups "RedLine13" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redline13+unsubscribe@googlegroups.com.
To post to this group, send email to redl...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/redline13/dbd9a55c-01f7-4873-a462-1a6b5fbfbc3b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.