LSD MemoryError
17 views
Skip to first unread message
Branimir Sesar
Dec 14, 2012, 11:09:26 AM12/14/12
to lsd-...@googlegroups.com
Dear all,
Does anyone know how this error may be avoided or fixed?
File "/home/bsesar/opt/lsd/src/lsd/pool2.py", line 85, in _worker
for result in mapper(item, *mapper_args):
File "/home/bsesar/opt/lsd/src/lsd/join_ops.py", line 2352, in _mapper
for result in mapper(qresult, *mapper_args):
File "./compute_ptf_stats.test", line 20, in calc_stats
for all_rows in colgroup.partitioned_fromiter(qresult, "_ID",
20*1000*1000,
blocks=True):
File "/home/bsesar/opt/lsd/src/lsd/colgroup.py", line 681, in
partitioned_fromiter
cPickle.dump(buf, fp, -1)
MemoryError
B
Does anyone know how this error may be avoided or fixed?
File "/home/bsesar/opt/lsd/src/lsd/pool2.py", line 85, in _worker
for result in mapper(item, *mapper_args):
File "/home/bsesar/opt/lsd/src/lsd/join_ops.py", line 2352, in _mapper
for result in mapper(qresult, *mapper_args):
File "./compute_ptf_stats.test", line 20, in calc_stats
for all_rows in colgroup.partitioned_fromiter(qresult, "_ID",
20*1000*1000,
blocks=True):
File "/home/bsesar/opt/lsd/src/lsd/colgroup.py", line 681, in
partitioned_fromiter
cPickle.dump(buf, fp, -1)
MemoryError
B
Reply all
Reply to author
Forward
0 new messages