Cannot run k6 test using current versions of Taurus (1.15.2, latest docker image)

[Natallia Savelyeva]

Hello,
The support of K6 was merged to master, however it is not possible to use k6 with the current version of Taurus (1.15.2) because the merge happened in February 2020 and Taurus was tagged as 1.15.2 in January 2020:  https://github.com/Blazemeter/taurus/tags.

The latest version of Taurus (as of today) is 1.15.2, it comes with `pip install bzt` command as the documented way of installation.
I tried the most recent docker images tagged as `latest` (does not work), `1.15.2` (does not work),  `master-391e69f7-2021-02-22` (worked).

Could you please fix this in the near future?

Details are listed below.

$ bzt tests/taurus_k6.yaml.    # directly from host
08:27:25 INFO: Taurus CLI Tool v1.15.2
08:27:25 INFO: Starting with configs: ['tests/taurus_k6.yaml']
08:27:25 INFO: Configuring...
08:27:25 INFO: Artifacts dir: /Users/n.savelyeva/notes/k6/explore/2021-02-26_08-27-25.738043
08:27:25 INFO: Preparing...
08:27:25 ERROR: Config Error: Module 'k6' not found in list of available aliases ['ab', 'android-emulator', 'apiritif', 'appium', 'blazemeter', 'capturehar', 'cloud', 'console', 'consolidator', 'external-results-loader', 'final-stats', 'final_stats', 'functional-consolidator', 'gatling', 'grinder', 'install-checker', 'jmeter', 'junit', 'junit-xml', 'local', 'locust', 'mocha', 'molotov', 'monitoring', 'newman', 'nunit', 'passfail', 'pip-install', 'proxy2jmx', 'pytest', 'robot', 'rspec', 'screenshoter', 'selenium', 'shellexec', 'siege', 'testng', 'tsung', 'unpacker', 'virtual-display', 'wdio', 'xunit']
08:27:25 INFO: Post-processing...
08:27:25 INFO: Artifacts dir: /Users/n.savelyeva/notes/k6/explore/2021-02-26_08-27-25.738043
08:27:25 WARNING: Done performing with code: 1

$ docker run --rm --mount type=bind,source=${PWD}/tests,target=/bzt-configs/tests --mount type=bind,source=${PWD}/results,target=/bzt-configs/results blazemeter/taurus /bzt-configs/tests/taurus_k6.yaml -o settings.artifacts-dir=results
07:28:45 INFO: Taurus CLI Tool v1.15.2
07:28:45 INFO: Starting with configs: ['/bzt-configs/tests/taurus_k6.yaml']
07:28:45 INFO: Configuring...
07:28:45 INFO: Artifacts dir: /bzt-configs/results
07:28:45 INFO: Preparing...
07:28:45 ERROR: Config Error: Module 'k6' not found in list of available aliases ['ab', 'android-emulator', 'apiritif', 'appium', 'blazemeter', 'capturehar', 'cloud', 'console', 'consolidator', 'external-results-loader', 'final-stats', 'final_stats', 'functional-consolidator', 'gatling', 'grinder', 'install-checker', 'jmeter', 'junit', 'junit-xml', 'local', 'locust', 'mocha', 'molotov', 'monitoring', 'newman', 'nunit', 'passfail', 'pip-install', 'proxy2jmx', 'pytest', 'robot', 'rspec', 'screenshoter', 'selenium', 'shellexec', 'siege', 'testng', 'tsung', 'unpacker', 'virtual-display', 'wdio', 'xunit']
07:28:45 INFO: Post-processing...
07:28:45 INFO: Artifacts dir: /bzt-configs/results
07:28:45 WARNING: Done performing with code: 1

$ pip3 freeze | grep bzt
bzt==1.15.2

$ docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
blazemeter/taurus master-391e69f7-2021-02-22 c39bdcf945e7 3 days ago 2.59GB
blazemeter/taurus 1.15.2 a6fa99c1c227 5 weeks ago 2.54GB
blazemeter/taurus latest a6fa99c1c227 5 weeks ago 2.54GB

[grey....@gmail.com]

Hi.

Could you explain what exactly we should fix?

---

Taras

[Natallia Savelyeva]

As I understand, tagging the master branch with new version and rebuilding the docker image can solve the issue.

In the version 1.15.2 and the corresponding docker image the following error is reported:

08:27:25 ERROR: Config Error: Module 'k6' not found in list of available aliases ['ab', 'android-emulator', 'apiritif', 'appium', 'blazemeter', 'capturehar', 'cloud', 'console', 'consolidator', 'external-results-loader', 'final-stats', 'final_stats', 'functional-consolidator', 'gatling', 'grinder', 'install-checker', 'jmeter', 'junit', 'junit-xml', 'local', 'locust', 'mocha', 'molotov', 'monitoring', 'newman', 'nunit', 'passfail', 'pip-install', 'proxy2jmx', 'pytest', 'robot', 'rspec', 'screenshoter', 'selenium', 'shellexec', 'siege', 'testng', 'tsung', 'unpacker', 'virtual-display', 'wdio', 'xunit']

The docker image tagged master-391e69f7-2021-02-22  does not have this error (details are written below).

$ docker run --rm --mount type=bind,source=${PWD}/tests,target=/bzt-configs/tests --mount type=bind,source=${PWD}/results,target=/bzt-configs/results blazemeter/taurus:master-391e69f7-2021-02-22 /bzt-configs/tests/taurus_k6.yaml -o settings.artifacts-dir=results
07:31:12 INFO: Taurus CLI Tool v1.15.2
07:31:12 INFO: Starting with configs: ['/bzt-configs/tests/taurus_k6.yaml']
07:31:12 INFO: Configuring...
07:31:12 INFO: Artifacts dir: /bzt-configs/results
07:31:12 INFO: Preparing...
07:31:12 WARNING: Guessed location from search paths for k6-test.js: /bzt-configs/tests/k6-test.js
07:31:12 INFO: Starting...
07:31:12 INFO: Waiting for results...
07:31:17 WARNING: Please wait for graceful shutdown...
07:31:17 INFO: Shutting down...
07:31:17 INFO: Post-processing...
07:31:17 INFO: Test duration: 0:00:05
07:31:17 INFO: Samples count: 20, 0.00% failures
07:31:17 INFO: Average times: total 0.410, latency 0.407, connect 0.036
07:31:17 INFO: Percentiles:
+---------------+---------------+
| Percentile, % | Resp. Time, s |
+---------------+---------------+
| 0.0 | 0.231 |
| 50.0 | 0.283 |
| 90.0 | 0.522 |
| 95.0 | 1.146 |
| 99.0 | 1.328 |
| 99.9 | 1.328 |
| 100.0 | 1.328 |
+---------------+---------------+
07:31:17 INFO: Request label stats:
+------------------------+--------+---------+--------+-------+
| label | status | succ | avg_rt | error |
+------------------------+--------+---------+--------+-------+
| https://blazedemo.com/ | OK | 100.00% | 0.410 | |
+------------------------+--------+---------+--------+-------+
07:31:17 INFO: Artifacts dir: /bzt-configs/results
07:31:17 INFO: Done performing with code: 0

[Natallia Savelyeva]

I found similar question here https://groups.google.com/g/codename-taurus/c/9QRZQJXrv8Y 

I mean I am already happy with the custom snapshot and custom docker image, but it will be good to know

when k6 is going to become available in the official version of Taurus and docker image 'latest'.
Thanks.

[grey....@gmail.com]

First of all having some [non-released yet] features  only in master isn't bug, do you agree? ;)
Brave users can take our unstable snapshot or 'unstable' image from docker hub to use it. 

Of course we'll release the feature in short time. Hard to say exact date, it should be month or two, I hope.

---

Taras