Crashing s3ql 3.7.3
27 views
Skip to first unread message
Amos T
Nov 5, 2021, 7:59:08 PM11/5/21
to s3ql
s3ql crashing for some reason
and makes it highly unstable on my sys.
--- snip ---
2021-11-06 00:47:40.630 2373161:Thread-2 s3ql.mount.exchook: Unhandled exception in thread, terminating
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.9/threading.py", line 892, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
self._do_upload(*tmp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
obj_size = backend.perform_write(do_write, 's3ql_data_%d'
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 279, in perform_write
return fn(fh)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
self.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
self._parse_error_response(resp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
2021-11-06 00:47:40.637 2373161:MainThread s3ql.mount.unmount: Unmounting file system...
2021-11-06 00:47:40.637 2373161:Thread-2 root.excepthook: Uncaught top-level exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.9/threading.py", line 892, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
self._do_upload(*tmp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
obj_size = backend.perform_write(do_write, 's3ql_data_%d'
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
--- snip ---
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.9/threading.py", line 892, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
self._do_upload(*tmp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
obj_size = backend.perform_write(do_write, 's3ql_data_%d'
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 279, in perform_write
return fn(fh)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
self.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
self._parse_error_response(resp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
2021-11-06 00:47:40.637 2373161:MainThread s3ql.mount.unmount: Unmounting file system...
2021-11-06 00:47:40.637 2373161:Thread-2 root.excepthook: Uncaught top-level exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.9/threading.py", line 892, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
self._do_upload(*tmp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
obj_size = backend.perform_write(do_write, 's3ql_data_%d'
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
--- snip ---
Amos T
Nov 6, 2021, 8:51:43 AM11/6/21
to s3ql
Keeps crashing
Such errors should not be in the logs and should be catched properly with exception handling and
clear description what does happen !!!
--- snip ---
2021-11-06 04:18:04.042 2371590:Thread-2 s3ql.mount.exchook: Unhandled exception in thread, terminating
2021-11-06 04:18:04.047 2371590:MainThread s3ql.mount.unmount: Unmounting file system...
2021-11-06 04:18:04.047 2371590:Thread-2 root.excepthook: Uncaught top-level exception:
2021-11-06 04:18:04.047 2371590:Thread-2 root.excepthook: Uncaught top-level exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/mount.py", line 58, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.9/threading.py", line 892, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 319, in _upload_loop
self._do_upload(*tmp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/block_cache.py", line 384, in _do_upload
obj_size = backend.perform_write(do_write, 's3ql_data_%d'
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 279, in perform_write
return fn(fh)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
self.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
self._parse_error_response(resp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
return fn(fh)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 389, in __exit__
self.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 383, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/comprenc.py", line 548, in close
self.fh.close()
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 912, in close
resp = self.backend._do_request('PUT', '/%s%s' % (self.backend.prefix, self.key),
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 531, in _do_request
self._parse_error_response(resp)
File "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py", line 565, in _parse_error_response
raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'), resp.headers)
s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot be found.
---
Op zaterdag 6 november 2021 om 00:59:08 UTC+1 schreef Amos T:
Nikolaus Rath
Nov 6, 2021, 9:39:29 AM11/6/21
to s3...@googlegroups.com
On Nov 05 2021, Amos T <amtr...@gmail.com> wrote:
> "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py",
> line 565, in _parse_error_response
> raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'),
> resp.headers)
> s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot
> be found.
Your server is emitting malformed error messages. They do not contain a
> "/usr/local/lib/python3.9/dist-packages/s3ql-3.7.3-py3.9-linux-x86_64.egg/s3ql/backends/s3c.py",
> line 565, in _parse_error_response
> raise get_S3Error(tree.findtext('Code'), tree.findtext('Message'),
> resp.headers)
> s3ql.backends.s3c.S3Error: NoSuchEntity: The entity in your request cannot
> be found.
"Message" tag which information about what the problem is.
Best,
-Nikolaus
--
GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
»Time flies like an arrow, fruit flies like a Banana.«
Nikolaus Rath
Nov 6, 2021, 9:40:42 AM11/6/21
to s3...@googlegroups.com
On Nov 06 2021, Amos T <amtr...@gmail.com> wrote:
> Such errors should not be in the logs and should be catched properly with
> exception handling and
> clear description what does happen !!!
Right you are! My sincere apologies for the bad service. I will forward
> Such errors should not be in the logs and should be catched properly with
> exception handling and
> clear description what does happen !!!
your complaint to the customer service department, who will contact you
shortly about refunding your service fee for this month.
Amtriorix SCS
Nov 6, 2021, 10:14:16 AM11/6/21
to s3...@googlegroups.com
Jesus, learn to code for god sake
your stuff is full of bugs
if you are roo lazy to code properly in
the ipensoirce community,
quit!
Op za 6 nov. 2021 14:40 schreef Nikolaus Rath <Niko...@rath.org>:
--
You received this message because you are subscribed to the Google Groups "s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email to s3ql+uns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/s3ql/87ee7te71l.fsf%40vostro.rath.org.
Esteban Fonseca
Nov 7, 2021, 5:16:10 PM11/7/21
to Amtriorix SCS, s3...@googlegroups.com
Hello Amos,
Even though you are rude and inconsiderate, and not even say "Hello" on your emails, I will give you two pointers that may help you solving your issues:
1. Try compiling the software from scratch, making sure you met all the pre-requisites
2. Make SURE you are running Python 3.9. Latest S3QL versions require this version as far as I know, and I was not successful at compiling them with python 3.8 or earlier.
If you are not running python 3.9, you will need to either upgrade it, or downgrade S3QL to an older version,
If you keep having issues, you can still try downgrading S3QL. Notice until 2 months ago we were using S3QL on our production hosting servers for backup purposes, serving over 5.000 customers.
If after all this you are still unsuccessful at setting up S3QL, you are very welcome to share your own code with the community.
Regards,
Esteban.
To view this discussion on the web visit https://groups.google.com/d/msgid/s3ql/CAJm0ZG5rg3QuhYCQChQ%2BE0CvOtAOO3Pw8MkVcR-PCqWFpypHww%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages