Jira (PDB-5203) Script that runs the pdb benchmark tests

[Andrei Filipovici (Jira)]

Andrei Filipovici created an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests Issue Type: Task Assignee: Unassigned Created: 2021/07/23 6:59 AM Priority: Normal Reporter: Andrei Filipovici The script does: pulls changes from the 6.x branch and copy the latest commit sha. in the locust results folder, create a folder with <current date without time>-<commit SHA>. inside this folder create another two named ingestion-ON and ingestion-OFF inside the two folders create folders 1000, 10.000, 100.000 and 500.000 The next section is repeated on the 1000, 10.000, 100.000 and 500.000 sandboxes start pdb after pdb started, run locust in the needed results folders with all queries, with a warmup with one user, another one with 1 user, 10 users and 20 users. go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used. go to the ingestion results folder and start locust again with the same settings. kill the benchmark after locust is done. kill pdb. !!!!!!! For the 500.000 sandbox you need to change the main sandboxes path. Add Comment

This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97)

[Andrei Filipovici (Jira)]

Andrei Filipovici updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests

Change By: Andrei Filipovici The script does: - pulls changes from the 6.x branch and copy the latest commit sha. - in In the locust results folder, create a folder with <current date without time>-<commit SHA>. - inside this folder create another two named ingestion-ON and ingestion-OFF - inside the two folders create folders 1000, 10.000, 100.000 and 500.000

The next section is repeated on the 1000, 10.000, 100.000 and 500.000 sandboxes

- start pdb - after pdb started, run locust in the needed results folders (the --csv parameter accepts folder paths) with all queries, with a warmup with one user, another one with 1 user, 10 users and 20 users. - go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used. - go to the ingestion results folder and start locust again with the same settings. - kill the benchmark after locust is done. - kill pdb.

!!!!!!! For the 500.000 sandbox you need to change the main sandboxes path.

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests Change By: Andrei Filipovici

The script does: - pulls changes from the 6.x branch and copy the latest commit sha.

In the locust results folder, create a folder with <current date without time>-<commit SHA>. - inside this folder create another two named ingestion-ON and ingestion-OFF - inside the two folders create folders 1000, 10.000, 100.000 and 500.000 The next section is repeated on the 1000, 10.000, 100.000 and 500.000 sandboxes - start pdb - after pdb started, run locust in the needed results folders (the --csv parameter accepts folder paths) with all queries, with a warmup with one user, another one with 1 user, 10 users and 20 users. - go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used. - go to the ingestion results folder and start locust again with the same settings. - kill the benchmark after locust is done. - kill pdb.

- inside the results folder delete the delete all files except the .html, _stats.csv and _failures.csv (not sure if we need those). Also the warmup files must be deleted. - Check the _failures.csv files, and if they are empty, delete them.

!!!!!!! For the 500.000 sandbox you need to change the main sandboxes path.

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests Change By: Andrei Filipovici

The script does:   -  if a commit SHA is given as a parameter, than it checkouts to that and holds the SHA in a variable, needed to name the results folder. If no SHA is given, it pulls the latest changes from the 6.x branch and copy copies in a variable the latest commit sha SHA . - In the locust results folder, create a folder with <current date without time>-<commit SHA>.

- inside this folder create another two named ingestion-ON and ingestion-OFF - inside the two folders create folders 1000, 10.000, 100.000 and 500.000

The next section is repeated on the 1000, 10.000, 100.000 and 500.000 sandboxes - start pdb - after pdb started, run locust in the needed results folders (the --csv parameter accepts folder paths) with all queries, with a warmup with one user, another one with 1 user, 10 users and 20 users. - go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used. - go to the ingestion results folder and start locust again with the same settings. - kill the benchmark after locust is done. - kill pdb. - inside the results folder delete the delete all files except the .html, _stats.csv and _failures.csv (not sure if we need those). Also the warmup files must be deleted. - Check the _failures.csv files, and if they are empty, delete them. !!!!!!! For the 500.000 sandbox you need to change the main sandboxes path.

Add Comment

[Bogdan Irimie (Jira)]

Bogdan Irimie updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests

Change By: Bogdan Irimie

The script does:  - if a commit SHA is given as a parameter, than it checkouts to that and holds the SHA in a variable, needed to name the results folder.

If no SHA is given, it pulls the latest changes from the 6.x branch and copies in a variable the latest commit SHA.

- In the locust results folder, create a folder with <current date without time>-<commit SHA>.

- inside this folder create - another two named ingestion-ON and - ingestion-OFF - inside the two folders create folders - 1000, 10.000, - 100.000 and - 500.000 -

The next section is repeated on the 1000, 10.000, 100.000 and 500.000 sandboxes

- start pdb - after pdb started, run locust in the needed results folders (the --csv parameter accepts folder paths) with all queries, with a warmup with one user, another one with - 1 user, 10 - - users - and 20 users. - - go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used. - - - go to the ingestion results folder and start locust again with the same settings. - - - kill the benchmark after locust is done. -

- kill pdb. - inside the results folder delete the delete all files except the .html, _stats.csv and _failures.csv (not sure if we need those). Also the warmup files must be deleted. - Check the _failures.csv files, and if they are empty, delete them.

- !!!!!!! For the 500.000 sandbox you need to change the main sandboxes path. -

Add Comment

[Bogdan Irimie (Jira)]

Bogdan Irimie updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests

Change By: Bogdan Irimie Story Points: 3

Add Comment

[Bogdan Irimie (Jira)]

Bogdan Irimie updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests

Change By: Bogdan Irimie Sprint: ghost-25.08.2021

Add Comment

[Sebastian Miclea (Jira)]

Sebastian Miclea assigned an issue to Sebastian Miclea

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests

Change By: Sebastian Miclea Assignee: Sebastian Miclea

Add Comment

[Sebastian Miclea (Jira)]

Sebastian Miclea updated an issue

PuppetDB / PDB-5203 Script that runs the pdb benchmark tests Change By: Sebastian Miclea

The script does:  - if a commit SHA is given as a parameter, than it checkouts to that and holds the SHA in a variable, needed to name the results folder. If no SHA is given, it pulls the latest changes from the 6.x branch and copies in a variable the latest commit SHA. - In the locust results folder, create a folder with <current date without time>-<commit SHA>.

- inside this folder create -another two named ingestion-ON and- ingestion-OFF

- inside the two folders create folders -1000, 10.000,- 100.000 and -500.000-

- start pdb - after pdb started, run locust in the needed results folders (the --csv parameter accepts folder paths) with all queries, with a warmup with one user, another one with -1 user, 10- -users- and 20 users.

- -go to n1 server and start the benchmark with (30 min run interval, 30% data change) and the appropriate number of hosts, depending on the sandbox that's used.- - -go to the ingestion results folder and start locust again with the same settings.- - -kill the benchmark after locust is done.-

- kill pdb. - inside the results folder delete

the delete all files except the .html, _stats.csv and _failures.csv (not sure if we need those). Also the warmup files must be deleted.

- Check the _failures.csv files, and if they are empty, delete them.

-!!!!!!! For the 500.000 sandbox you need to change the main sandboxes path.-

Add Comment