Too much sessions...
Gaël Princivalle
Fekete Zoltán
Gaël Princivalle
0_memcache.py model file I've got this ticket:<type 'exceptions.ImportError'> Cannot import module 'applications.my_app.modules.six'
Fekete Zoltán
Gaël Princivalle
<type 'exceptions.ImportError'> Cannot import module 'applications.hydrover_oleodinamica.modules.six'
Versione
| web2py™ | Version 2.14.6-stable+timestamp.2016.05.10.00.21.47 |
|---|---|
| Python | Python 2.7.5: /usr/bin/python (prefix: /usr) |
Traceback
1. | Traceback (most recent call last): |
Error snapshot
<type 'exceptions.ImportError'>(Cannot import module 'applications.hydrover_oleodinamica.modules.six')
Frames
-
File /home/tasko/webapps/w2p_2_14_16/web2py/gluon/custom_import.py in custom_importer at line 89 code arguments variables
Function argument list
(name='six', globals={'__builtins__': {'ArithmeticError': <type 'exceptions.ArithmeticError'>, 'AssertionError': <type 'exceptions.AssertionError'>, 'AttributeError': <type 'exceptions.AttributeError'>, 'BaseException': <type 'exceptions.BaseException'>, 'BufferError': <type 'exceptions.BufferError'>, 'BytesWarning': <type 'exceptions.BytesWarning'>, 'DeprecationWarning': <type 'exceptions.DeprecationWarning'>, 'EOFError': <type 'exceptions.EOFError'>, 'Ellipsis': Ellipsis, 'EnvironmentError': <type 'exceptions.EnvironmentError'>, ...}, '__doc__': None, '__file__': None, '__name__': None, '__package__': None, 'binascii': None, 'os': None, 'pickle': None, 'print_function': None, 're': None, ...}, locals={'__builtins__': {'ArithmeticError': <type 'exceptions.ArithmeticError'>, 'AssertionError': <type 'exceptions.AssertionError'>, 'AttributeError': <type 'exceptions.AttributeError'>, 'BaseException': <type 'exceptions.BaseException'>, 'BufferError': <type 'exceptions.BufferError'>, 'BytesWarning': <type 'exceptions.BytesWarning'>, 'DeprecationWarning': <type 'exceptions.DeprecationWarning'>, 'EOFError': <type 'exceptions.EOFError'>, 'Ellipsis': Ellipsis, 'EnvironmentError': <type 'exceptions.EnvironmentError'>, ...}, '__doc__': None, '__file__': None, '__name__': None, '__package__': None, 'binascii': None, 'os': None, 'pickle': None, 'print_function': None, 're': None, ...}, fromlist=[], level=-1)
Code listing
84.
85.
86.
87.
88.89.
90.
91.
92.
93.new_mod = base_importer(
modules_prefix, globals, locals, [itemname], level)
try:
result = result or sys.modules[modules_prefix+'.'+itemname]
except KeyError, e:raise ImportError, 'Cannot import module %s' % str(e)
modules_prefix += "." + itemname
return result
else:
# import like "from x import a, b, ..."Variables
builtinstr <type 'str'> builtinImportError <type 'exceptions.ImportError'> e KeyError('applications.hydrover_oleodinamica.modules.six',)
In file: /home/tasko/webapps/w2p_2_14_16/web2py/applications/hydrover_oleodinamica/models/0_memcache.py
1. | # -*- coding: utf-8 -*- |
Fekete Zoltán
Dave S
On Friday, July 12, 2019 at 1:00:03 AM UTC-7, Gaël Princivalle wrote:
Hi all.In my sessions folder all sessions are stored in separated sub-folders, 068,069...The file system don't accept more than 512 sub-folders in a folder.When I reach 512 sub-folders the website is down.Now for avoiding this problem I delete all the sessions with a crontab job every 12 hours, but it's not enough.Obviously I can imagine that deleting all the sessions means also disconnecting all the users, that's not a good thing.
You've already moved on, it seems, but there's a script in the archives (I think I reposted it once, originally from Massimo)
and that script cleans up the sessions; with normal options, it deletes expired sessions only, but can delete all sessions older than x seconds, etc.
My website is getting around 5 hits per second 24-7; cleaning once a day was getting dicey (in df terms, rather than directly in dir entries), so I do it twice a day now -- via scheduler -- and manually if I look in and see an issue developing.
The script runs well as module called from the scheduler, and it sends me email if after cleaning df is still too low.
(This is an AWS ec2 instance, so the primary disk is small; we have a second disk we archive off to;
one app has a handful of uploads each week, and the uwsgi logs autorotate, but don't purge, so I still get to do housekeeping.)
/dps
Massimo Di Pierro
Fekete Zoltán
Gaël Princivalle
Gaël Princivalle
Gaël Princivalle
Ticket ID
2a00_23a8_400d_c001_3d4c_5b50_35a9_dfdf.2019-07-19.12-25-46.c3413f14-b228-4390-bc14-2f7092907e01
Versione
| web2py™ | Version 2.14.6-stable+timestamp.2016.05.10.00.21.47 |
|---|---|
| Python | Python 2.7.5: /usr/bin/python (prefix: /usr) |
Traceback
1. |
Traceback (most recent call last): |
Error snapshot
<type 'exceptions.RuntimeError'>(Too many ID conflicts)
Frames
File /home/tasko/webapps/w2p_2_14_16/web2py/gluon/contrib/memdb.py in insert at line 264 code arguments variables
Function argument list
(self=<DALStorage {'client_ip': <pydal.objects.Field o... <pydal.objects.Field object at 0x7f6dd7c6e890>}>, **fields={'client_ip': '2a00.23a8.400d.c001.3d4c.5b50.35a9.dfdf', 'locked': False, 'modified_datetime': datetime.datetime(2019, 7, 19, 12, 25, 46, 854949), 'session_data': '\x80\x02cgluon.globals\nSession\nq\x01}q\x02(U\x19_formkey[no_tab...\x13(h\x0bU\r75.0.3770.142q\x14h\rU\x06Chromeq\x15u\x85Rq\x16u\x85Rq\x17u\x85Rq\x18.', 'unique_key': '25d6cb33-4709-4b14-987d-06aef044ac67'})
Code listing
259.
260.
261.
262.
263.264.
265.
266.
267.
268.for i in range(3):
id = self._create_id()
if self.get(id) is None and self.update(id, **fields):
return long(id)
else:raise RuntimeError("Too many ID conflicts")
def get(self, id):
val = self._tableobj.get(self._id_to_key(id))
if val: