Python3: OSError: telling position disabled by next() call

[jay.wi...@gmail.com]

Hi, 

I'm getting an error running bzt in jenkins.  My job runs for 30s to 1minute and then consistently dies with this error.  Any ideas on what is going wrong?  

[2015-12-14 11:44:31,912 INFO Engine.console] Test is running...
[2015-12-14 11:44:31,952 DEBUG Engine] Iteration took 19.351 sec, sleeping for -18.351 sec...
[2015-12-14 11:44:31,953 DEBUG root] Checking <bzt.modules.provisioning.Local object at 0x7f0f9126e748>
[2015-12-14 11:44:31,953 DEBUG root] Checking jmeter/api-simple-read
[2015-12-14 11:44:31,953 DEBUG root] Checking <bzt.modules.aggregator.ConsolidatingAggregator object at 0x7f0f91afcac8>
[2015-12-14 11:44:32,351 DEBUG Engine.jmeter.JTLReader.IncrementalCSVReader] Reading JTL: /var/lib/jenkins/jobs/loadtest-api-simple-read/workspace/2015-12-14_11-43-42.874892/kpi.jtl
[2015-12-14 11:44:32,365 INFO Engine] Shutting down...
[2015-12-14 11:44:32,427 DEBUG Engine.local] Shutdown jmeter/api-simple-read
[2015-12-14 11:44:33,428 INFO Engine.jmeter] Sending Shutdown command to JMeter on port 4445...
[2015-12-14 11:44:34,430 DEBUG Engine.jmeter] JMeter stopped on Shutdown command
[2015-12-14 11:44:34,432 DEBUG Engine.Configuration] Dumping YAML config into /var/lib/jenkins/jobs/loadtest-api-simple-read/workspace/2015-12-14_11-43-42.874892/effective.yml
[2015-12-14 11:44:34,456 DEBUG Engine.Configuration] Dumping JSON config into /var/lib/jenkins/jobs/loadtest-api-simple-read/workspace/2015-12-14_11-43-42.874892/effective.json
[2015-12-14 11:44:34,463 DEBUG root] Caught exception in try: Traceback (most recent call last):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/cli.py", line 147, in perform
    self.engine.run()
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/engine.py", line 127, in run
    self._wait()
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/engine.py", line 156, in _wait
    while not EngineModule.check_modules_list(modules):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/engine.py", line 772, in check_modules_list
    finished |= module.check()
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 563, in check
    for point in self.datapoints():
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 379, in datapoints
    for datapoint in self._calculate_datapoints(final_pass):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 592, in _calculate_datapoints
    self._process_underlings(final_pass)
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 577, in _process_underlings
    for data in [x for x in underling.datapoints(final_pass)]:
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 577, in <listcomp>
    for data in [x for x in underling.datapoints(final_pass)]:
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 379, in datapoints
    for datapoint in self._calculate_datapoints(final_pass):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/jmeter.py", line 1653, in _calculate_datapoints
    for point in super(JTLReader, self)._calculate_datapoints(final_pass):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 474, in _calculate_datapoints
    self.__process_readers(final_pass)
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/aggregator.py", line 426, in __process_readers
    for result in self._read(final_pass):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/jmeter.py", line 1622, in _read
    for row in self.csvreader.read(last_pass):
  File "/var/lib/jenkins/pyenv/versions/loadtest-api-simple-read/lib/python3.4/site-packages/bzt/modules/jmeter.py", line 1698, in read
    self.offset = self.fds.tell()
OSError: telling position disabled by next() call

[2015-12-14 11:44:34,463 ERROR root] OSError: telling position disabled by next() call

thanks!

Jay

[Andrey Pokhilko]

Hi,

Can you provide full bzt.log, please?

Andrey Pohilko Chief Scientist P: +7 (909) 631-21-69

--
You received this message because you are subscribed to the Google Groups "codename-taurus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codename-taur...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/codename-taurus/aa64063f-d4b8-498a-8681-86d9a552f984%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jay Wineinger]

Hi Andrey,

I've attached the bzt.log though I did sanitize it slightly by removing my URLs.

thanks!

Jay

--
You received this message because you are subscribed to a topic in the Google Groups "codename-taurus" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/codename-taurus/YUCqeqB84hc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to codename-taur...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/codename-taurus/566F06B1.3000009%40blazemeter.com.

[Jay Wineinger]

Also, I should note that the same job succeeds on my mac while jenkins is an Ubuntu 14.04 box.  Same python version (3.4.3) used on both.  My mac's python is brew installed while jenkins is using pyenv.

[Andrey Pokhilko]

Hi,

This is interesting issue. Can you try with Python 2.7 just to see if the issue will reproduce?

Andrey Pohilko Chief Scientist P: +7 (909) 631-21-69

[Jay Wineinger]

It does execute normally on both my jenkins and mac with 2.7.  

[Andrey Pokhilko]

I tried to do some work on the code to possibly workaround the problem. I say "possibly" because I failed to reproduce it on my Ubuntu 14.04 with python 3.4.

Please try using the snapshot bzt-0.5.0.519.tar.gz from http://gettaurus.org/docs/DeveloperGuide/#Python-Egg-Snapshots , download and install it like 'pip install bzt-0.5.0.519.tar.gz'. Let me know of results.

Andrey Pohilko Chief Scientist P: +7 (909) 631-21-69

[Jay Wineinger]

Hi Andrey,

Thanks for the fix attempt. I reran my test using that version of bzt and unfortunately I'm seeing the same behavior.  I've attached the new bzt.log.

Jay

[Andrey Pokhilko]

Unfortunately, I'm unable to understand why it happens. I use no iterating over file descriptor, it works for all my envs. It even works at your mac with same python version. That's totally confusing.

If possible, try using Python 2.7 for your tests, or some other version of Python 3. It could be just issue in that particular python interpreter.

Sorry...

Andrey Pohilko Chief Scientist P: +7 (909) 631-21-69