File too large

[Smart]

Good morning,



Traceback (most recent call last):
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/controllers/wsgi.py", line 95, in get_response
self._response = callback(request, *args, **kwargs)
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/dbapi/orm/decorators.py", line 24, in _wrapper
wsgi_app = controller_class(req, dbname)
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/controllers/zodb.py", line 21, in __init__
self.setup_database(db_name)
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/controllers/zodb.py", line 28, in setup_database
self.db = self.zodb_backend_class(db_name)
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/dbapi/orm/zodb_compat.py", line 18, in __init__
super(ClientStorageProxy, self).__init__(db_name, **kwargs)
File "/home/gator/django-hotsauce-1.0-mainline/lib/notmm/dbapi/orm/_databaseproxy.py", line 41, in __init__
self.conn = db_connection_cls(db_name)
File "/home/erob/src/libschevo-4.1/lib/schevo/backends/zodb.py", line 46, in __init__
self._storage = ClientStorage((self.host, int(self.port)))
File "/usr/local/lib/python2.7/dist-packages/ZEO/ClientStorage.py", line 234, in __init__
cache, var, client, storage, cache_size)
File "/usr/local/lib/python2.7/dist-packages/ZEO/ClientStorage.py", line 1270, in open_cache
return ClientCache(None, cache_size)
File "/usr/local/lib/python2.7/dist-packages/ZEO/cache.py", line 211, in __init__
self._initfile(fsize)
File "/usr/local/lib/python2.7/dist-packages/ZEO/cache.py", line 340, in _initfile
seek(ofs)
IOError: [Errno 27] File too large

Any thoughts about how to fix this unexpected problem with ZODB clientstorage ?

Thank you in advance,
Jack


--
Jack Bortone <ja...@isotopesoftware.ca>

[Smart]

On Tue, 7 Jan 2020 11:41:28 +0100
Jürgen Gmach <juerge...@googlemail.com> wrote:

> Is it possible that you try to process a file which is bigger than
> your OS supports? e.g. a FAT formatted drive
>
> Best,
> Jürgen

Hi,

this is a relatively small database :

$ stat /var/db/zodb27/blogs.fs

File: /var/db/zodb27/blogs.fs
Size: 112520 Blocks: 224 IO Block: 4096 regular file
Device: 801h/2049d Inode: 22822161 Links: 1
Access: (0775/-rwxrwxr-x) Uid: ( 1001/ gator) Gid: ( 1001/ gator)
Access: 2020-01-06 13:02:31.087236437 -0500
Modify: 2019-03-06 00:46:55.073097916 -0500
Change: 2020-01-06 13:02:24.043236619 -0500
Birth: -

Im suspecting its a cache issue with ZEO 5.2.1

Kind regards,

[Jason Madden]

You don't provide much information for us to go on, so this is all conjecture.

That code hasn't changed in quite some time (since 5.0a0, 2016), and even then it was just adding a lock, so I would be more suspicious of the local environment. How do you have the cache configured? It's possible you have a very large cache size specified, and when the code attempts to seek to adjust the file size, it's exceeding a 32-bit limit. This is especially likely if you are running a 32-bit Python or have otherwise built it without large file support.

The code attempts to gracefully handle bad cache files from the line in question. It first removes the file that caused the error and then recreates it. There should be logging to that effect. If so, the file on disk you see after this doesn't reflect the file that caused the error (but an older bad file might).

~Jason

> --
> You received this message because you are subscribed to the Google Groups "zodb" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to zodb+uns...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/zodb/20200106113738.c4337790150b9e594dd16c70%40yandex.com.