Crashing s3ql 3.7.3

27 views
Skip to first unread message

Amos T

unread,
Nov 5, 2021, 7:59:08 PM11/5/21
to s3ql
s3ql crashing for some reason
and makes it highly unstable on my sys.

--- snip ---
2021-11-06 00:47:40.630 2373161:Thread-2 s3ql.mount.exchook: Unhandled exception in thread, terminating
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
    run_old(*args, **kw)
  File "/usr/lib/python3.9/threading.py", line 892, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
    self._do_upload(*tmp)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
    obj_size = backend.perform_write(do_write, 's3ql_data_%d'
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
    return method(*a, **kw)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 279, in perform_write
    return fn(fh)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
    self.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
    self.fh.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
    self.fh.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
    return method(*a, **kw)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
    resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
    self._parse_error_response(resp)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
    raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
2021-11-06 00:47:40.637 2373161:MainThread s3ql.mount.unmount: Unmounting file system...
2021-11-06 00:47:40.637 2373161:Thread-2 root.excepthook: Uncaught top-level exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
    run_old(*args, **kw)
  File "/usr/lib/python3.9/threading.py", line 892, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
    self._do_upload(*tmp)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
    obj_size = backend.perform_write(do_write, 's3ql_data_%d'
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
    return method(*a, **kw)
--- snip ---

Amos T

unread,
Nov 6, 2021, 8:51:43 AM11/6/21
to s3ql
Keeps crashing

Such errors should not be in the logs and should be catched properly with exception handling and
clear description what does happen !!!

--- snip ---
2021-11-06 04:18:04.042 2371590:Thread-2 s3ql.mount.exchook: Unhandled exception in thread, terminating
2021-11-06 04:18:04.047 2371590:MainThread s3ql.mount.unmount: Unmounting file system...
2021-11-06 04:18:04.047 2371590:Thread-2 root.excepthook: Uncaught top-level exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
    run_old(*args, **kw)
  File "/usr/lib/python3.9/threading.py", line 892, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
    self._do_upload(*tmp)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
    obj_size = backend.perform_write(do_write, 's3ql_data_%d'
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
    return method(*a, **kw)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 279, in perform_write
    return fn(fh)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
    self.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
    self.fh.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
    self.fh.close()
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
    return method(*a, **kw)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
    resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
    self._parse_error_response(resp)
  File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
    raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
---

Op zaterdag 6 november 2021 om 00:59:08 UTC+1 schreef Amos T:

Nikolaus Rath

unread,
Nov 6, 2021, 9:39:29 AM11/6/21
to s3...@googlegroups.com
On Nov 05 2021, Amos T <amtr...@gmail.com> wrote:
> "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py",
> line 565, in _parse_error_response
> raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'),
> resp.headers)
> s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot
> be found.

Your server is emitting malformed error messages. They do not contain a
"Message" tag which information about what the problem is.

Best,
-Nikolaus

--
GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

»Time flies like an arrow, fruit flies like a Banana.«

Nikolaus Rath

unread,
Nov 6, 2021, 9:40:42 AM11/6/21
to s3...@googlegroups.com
On Nov 06 2021, Amos T <amtr...@gmail.com> wrote:
> Such errors should not be in the logs and should be catched properly with
> exception handling and
> clear description what does happen !!!

Right you are! My sincere apologies for the bad service. I will forward
your complaint to the customer service department, who will contact you
shortly about refunding your service fee for this month.

Amtriorix SCS

unread,
Nov 6, 2021, 10:14:16 AM11/6/21
to s3...@googlegroups.com
Jesus, learn to code for god sake
your stuff is full of bugs 

if you are roo lazy to code properly in
the ipensoirce community,

quit!

Op za 6 nov. 2021 14:40 schreef Nikolaus Rath <Niko...@rath.org>:
--
You received this message because you are subscribed to the Google Groups "s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email to s3ql+uns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/s3ql/87ee7te71l.fsf%40vostro.rath.org.

Esteban Fonseca

unread,
Nov 7, 2021, 5:16:10 PM11/7/21
to Amtriorix SCS, s3...@googlegroups.com
Hello Amos,

Even though you are rude and inconsiderate, and not even say "Hello" on your emails, I will give you two pointers that may help you solving your issues:

1. Try compiling the software from scratch, making sure you met all the pre-requisites
2. Make SURE you are running Python 3.9. Latest S3QL versions require this version as far as I know, and I was not successful at compiling them with python 3.8 or earlier.

If you are not running python 3.9, you will need to either upgrade it, or downgrade S3QL to an older version,

If you keep having issues, you can still try downgrading S3QL. Notice until 2 months ago we were using S3QL on our production hosting servers for backup purposes, serving over 5.000 customers.

If after all this you are still unsuccessful at setting up S3QL, you are very welcome to share your own code with the community.

Regards,
Esteban.


To view this discussion on the web visit https://groups.google.com/d/msgid/s3ql/CAJm0ZG5rg3QuhYCQChQ%2BE0CvOtAOO3Pw8MkVcR-PCqWFpypHww%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages