EMFILE error on bulk data insert through HTTP-REQUEST

44 views
Skip to first unread message

ManojKumar G

unread,
Jul 23, 2016, 1:59:47 PM7/23/16
to nodejs
Hi all,
I'm developing an loopback application to get data using oracledb npm module from ORACLE and convert it to JSON format to be stored in MONGODB.
MONGODBis accessed using "loopback-connector-mongodb".
The data to be stored would be around for 100 collections as of for 100 tables from ORACLE. 
I'm pushing data with http request row by row for the entire collection list from node server from my local application to another server application on remote machine using http-request through remote method call.

When the data write operation the remote machine application stops throwing an error showing "EMFILE error". 
 
I googled and some reference showed that it is because of the maximum number of opened files/sockets. Hence i tried disconnecting the DataSource for each request. Still i'm getting the same error.

Please help me on this!!

Thanks.

Ryan Graham

unread,
Jul 23, 2016, 2:56:34 PM7/23/16
to nodejs

This was also posted on stackoverflow earlier (where I posted my reply).

http://stackoverflow.com/q/38540288/62525

~Ryan


--
Job board: http://jobs.nodejs.org/
New group rules: https://gist.github.com/othiym23/9886289#file-moderation-policy-md
Old group rules: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
---
You received this message because you are subscribed to the Google Groups "nodejs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nodejs+un...@googlegroups.com.
To post to this group, send email to nod...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nodejs/507d495f-aca4-48c0-8ebc-af6961624683%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--

~Ryan

Matt

unread,
Jul 23, 2016, 6:44:55 PM7/23/16
to nod...@googlegroups.com
What is your limit set to? Most node apps need the limit increased due to the process model.

I set mine to 6400 usually via "ulimit -n 6400" before starting the app.

Reply all
Reply to author
Forward
0 new messages