Twisted 8.1

[Jorge Cabello]

Hi,

Yesterday I had problems with Twisted 8.1 after an upgrade (debian
testing): python-twisted 8.1.0-4

All the commands which tried to connect to a host didn't finish and I
had to stop them using ctrl+C, getting the following output:

...
caller_connect: could not connect to remote host caotica.aspl.es, reason [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion: Connection lost.
]
Unhandled error in Deferred:
Traceback (most recent call last):
File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 1086, in clientConnectionLost
self._failAll(reason)
File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 1073, in _failAll
d.errback(reason)
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 269, in errback
self._startRunCallbacks(fail)
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 312, in _startRunCallbacks
self._runCallbacks()
--- <exception caught here> ---
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 328, in _runCallbacks
self.result = callback(self.result, *args, **kw)
File "/usr/local/lib/python2.5/site-packages/ganeti/rpc.py", line 103, in cb_err1
self._check_end()
File "/usr/local/lib/python2.5/site-packages/ganeti/rpc.py", line 64, in _check_end
reactor.stop()
File "/usr/lib/python2.5/site-packages/twisted/internet/base.py", line 495, in stop
"Can't stop reactor that isn't running.")
twisted.internet.error.ReactorNotRunning: Can't stop reactor that isn't running.
...

Installing again Twisted 2.5 fix de problem.

[Iustin Pop]

On Tue, Dec 2, 2008 at 17:53, Jorge Cabello <jo...@aspl.es> wrote:
>
> Hi,
>
> Yesterday I had problems with Twisted 8.1 after an upgrade (debian
> testing): python-twisted 8.1.0-4
>
> All the commands which tried to connect to a host didn't finish and I
> had to stop them using ctrl+C, getting the following output:

[...]

>
> Installing again Twisted 2.5 fix de problem.
>

This is a known problem and was fixed in version 1.2.5. What version
are you running?

iustin

[Jorge Cabello]

Sorry, I forgot that information:

I have tried versions 1.2.6 and 1.2.5, in that order, without success.

[Iustin Pop]

Hmm, strange.

Did you install from source?

iustin

[Jorge Cabello]

Yes, both of them (1.2.6 and 1.2.5).

Now its working perfectly with twisted 2.5 (also installed from source
because of debian dependency problems).

It isn't a production server so I can make some tests to try to find
where the problem is. I only need to know what tests I must do.

[Iustin Pop]

So, this is strange - I've tested 8.1 with 1.2.5 half a year or so ago
and it worked.

The only thing I can think of is mismatched ganeti libraries or so... if
you can check you have only one copy of ganeti/rpc.py on the system that
would be great.

Otherwise I'll try to reproduce the problem on a freshly installed
system to see how it breaks...

thanks,
iustin

[Jorge Cabello]

Tried without success.

I have uninstalled ganeti and twisted and checked there weren't older
versions of ganeti or twisted in /var and /usr. The only files remaining
were:
/var/log/ganeti/*
/var/lib/ganeti/ (config files)
/var/run/ganeti/bdev*
/var/run/ganeti/instance-disks
/usr/src/... (sources files)

rpc.py was only found in:
/usr/lib/python2.5/idlelib/rpc.py
/usr/lib/python2.4/idlelib/rpc.py

After checking that I have reinstalled twisted using debian testing
packages (python-twisted 8.1.0-4), rebuilt ganeti and reinstalled it.

The problem was the same: commands doesn't finish.
Output after using ctrl+c:

caller_connect: could not connect to remote host caotica.aspl.es, reason [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion: Connection lost.
]
Unhandled error in Deferred:
Traceback (most recent call last):
File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 1086, in clientConnectionLost
self._failAll(reason)
File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 1073, in _failAll
d.errback(reason)
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 269, in errback
self._startRunCallbacks(fail)
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 312, in _startRunCallbacks
self._runCallbacks()
--- <exception caught here> ---
File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 328, in _runCallbacks
self.result = callback(self.result, *args, **kw)
File "/usr/local/lib/python2.5/site-packages/ganeti/rpc.py", line 103, in cb_err1
self._check_end()
File "/usr/local/lib/python2.5/site-packages/ganeti/rpc.py", line 64, in _check_end
reactor.stop()
File "/usr/lib/python2.5/site-packages/twisted/internet/base.py", line 495, in stop
"Can't stop reactor that isn't running.")
twisted.internet.error.ReactorNotRunning: Can't stop reactor that isn't running.

Reinstalling twisted 2.5 made ganeti to work again.