ERROR: exceeded maxAllocatedDescs (492)

141 views
Skip to first unread message

Isaías Sánchez

unread,
Dec 9, 2014, 7:07:26 AM12/9/14
to cstore...@googlegroups.com
I am using cstore_fdw to compress a list of tables in partitions for easy deletion and using a view to look data into all of them.

When I tray to run a query this error appear and the query don't give me any results.

ERROR:  exceeded maxAllocatedDescs (492) while trying to open file "/usr/local/pgsql93/data/cstore_fdw/16385/96816.footer"

Any ideas to solve this?

Isaías Sánchez

unread,
Dec 9, 2014, 10:40:07 AM12/9/14
to cstore...@googlegroups.com
I made some test and seems the problem comes with the view that can't have more than 492 cstore tables using UNION ALL.

I don't know if it's a limitation of ORC, PostgreSQL or cstore_fdw.

I'll put a limit on my amount of foreign tables by now.

Hadi Moshayedi

unread,
Dec 10, 2014, 8:04:16 AM12/10/14
to Isaías Sánchez, cstore...@googlegroups.com
Hello Isaías,

I think in Linux there is a limit on number of open files that a process can have. You can view this by "cat /proc/<pid>/limits". This shows 1024 for me. I am guessing the problem you're facing is because each cstore table has two files (footer and data), so you're limited to about 500 files in a single query.

Maybe you can search and find a way to raise these limits for each process for your OS.

Thanks,
  -- Hadi


--
You received this message because you are subscribed to the Google Groups "cstore users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cstore-users...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages