Horribly weird error from boto

[floria...@gmail.com]

After testing wal-e successfully on a test cluster, I've added it to production, with less charming (for me) results.

I'm trying to store to S3.

I get a internal explosion from gevent.

TypeError: memoryview: str object does not have the buffer interface

I added the full output further down.

Same thing occurs if I try 'backup-list'

1) The immediate suspect is that the postgres box there has no outgoing connectivity except via proxy.

2) The proxy _is_ set in the environment for my env-loading wrapper.

3) after somewhat hopeless confusion I found out that this is using "boto" version 2 which seems to not notice any envvars you set.

It should read a .boto file though, so I also created that and set a proxy in there.

Either it's not reading that or I have another problem.

Can anyone translate the error for me? 

Thank you,

Florian

Here's the debugging info:

pip tells me I have the following versions of things:

boto (2.45.0)

gevent (1.2.0)

greenlet (0.4.11)

pip (8.1.2)

setuptools (19.2)

wal-e (1.0.3)

It's on Centos7 with python 3.4.5

Fri Jan  6 21:24:09 2017 <Greenlet at 0x7f8d35488e88: <wal_e.worker.upload.WalUploader object at 0x7f8d35575080>(<wal_e.worker.pg.wal_transfer.WalSegment object at)> failed with TypeError

wal_e.main   CRITICAL MSG: An unprocessed exception has avoided all error handling

        DETAIL: Traceback (most recent call last):

          File "/usr/lib/python3.4/site-packages/wal_e/cmd.py", line 641, in main

            concurrency=args.pool_size)

          File "/usr/lib/python3.4/site-packages/wal_e/operator/backup.py", line 283, in wal_archive

            group.join()

          File "/usr/lib/python3.4/site-packages/wal_e/worker/pg/wal_transfer.py", line 144, in join

            raise val

          File "/usr/lib64/python3.4/site-packages/gevent/greenlet.py", line 536, in run

            result = self._run(*self.args, **self.kwargs)

          File "/usr/lib/python3.4/site-packages/wal_e/worker/upload.py", line 53, in __call__

            self.gpg_key_id)

          File "/usr/lib/python3.4/site-packages/wal_e/worker/worker_util.py", line 40, in do_lzop_put

            k = blobstore.uri_put_file(creds, url, tf)

          File "/usr/lib/python3.4/site-packages/wal_e/blobstore/s3/s3_util.py", line 57, in uri_put_file

            k.set_contents_from_file(fp, encrypt_key=True)

          File "/usr/lib/python3.4/site-packages/boto/s3/key.py", line 1293, in set_contents_from_file

            chunked_transfer=chunked_transfer, size=size)

          File "/usr/lib/python3.4/site-packages/boto/s3/key.py", line 750, in send_file

            chunked_transfer=chunked_transfer, size=size)

          File "/usr/lib/python3.4/site-packages/boto/s3/key.py", line 951, in _send_file_internal

            query_args=query_args

          File "/usr/lib/python3.4/site-packages/boto/s3/connection.py", line 668, in make_request

            retry_handler=retry_handler

          File "/usr/lib/python3.4/site-packages/boto/connection.py", line 1071, in make_request

            retry_handler=retry_handler)

          File "/usr/lib/python3.4/site-packages/boto/connection.py", line 913, in _mexe

            self.is_secure)

          File "/usr/lib/python3.4/site-packages/boto/connection.py", line 705, in get_http_connection

            return self.new_http_connection(host, port, is_secure)

          File "/usr/lib/python3.4/site-packages/boto/connection.py", line 747, in new_http_connection

            connection = self.proxy_ssl(host, is_secure and 443 or 80)

          File "/usr/lib/python3.4/site-packages/boto/connection.py", line 796, in proxy_ssl

            sock.sendall("CONNECT %s HTTP/1.0\r\n" % host)

          File "/usr/lib64/python3.4/site-packages/gevent/_socket3.py", line 408, in sendall

            data_memory = _get_memory(data)

          File "/usr/lib64/python3.4/site-packages/gevent/_socket3.py", line 35, in _get_memory

            mv = memoryview(data)

        TypeError: memoryview: str object does not have the buffer interface

        

        STRUCTURED: time=2017-01-06T21:24:09.430205-00 pid=22866