generating report takes a long time

22 views
Skip to first unread message

aostad

unread,
Jan 16, 2024, 8:25:47 AMJan 16
to Serenity BDD Users Group
Java SDK 8 (1.8)
Serenity 2.3.4
Serenity.Cucumber6 2.34
Spring framework 2.1.18.RELEASE
RESTFull API testing

Hi Everyone,
I just want to bring up an issue that I'm facing and share with you the workaround I'm using.

My project includes the above configuration. I have a test scenario with about 400 line of test data in a table under "Examples:" section in the feature file as depict below:

Scenario Outline: Initiate payment with invalid data
Given all necessary variables are initialized
When Arya sends a request without "<missingFieldd>" in the payload
Then the error response has the expected "<errorCode>" and "<errorMsg>"
Examples:
| testCaseNumber | missingField | errrorCode | errorMsg |
| 001                         | firstName      | 400             | mandatory field first_name is required |
| 002                         | lastName      | 400             | mandatory field last_name is required |
....
| 400                          | amount         | 400             | mandatory field amount is required |


the execution time is reasonable and is done fast. After executing the last row (400), some processes started to generate reports. This step takes forever.

When the number of rows is a few the delay is not noticeable, however, when we have hundreds of them it takes hours. Sometimes the PC looks hung up due to the extreme delay in generating the report.

After debugging, I noticed Serenity goes through a long process after the last execution to retrieve data and generate files and links.

This issue makes the important feature of cucumber useless as you cannot have one test case with a considerable amount of rows of data in the table.

My Workaround:
for each row, simply repeat the steps by creating a new test case for each row. In other words, you may have a table of data with one row.

This simple change helps to generate the reports in a couple of minutes and saves you hours.

If you have experienced this issue please let me know. If you have a better solution, I'll be happy to hear it.

BTW, I have tried to update the project using a newer version of Serenity but encountered many compiling and dependency issues, so I gave up..

Cheers.

Reply all
Reply to author
Forward
0 new messages