Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Database fastinsert slow

13 views
Skip to first unread message

Gerald Corzo

unread,
Dec 2, 2009, 11:44:20 AM12/2/09
to
I am trying to insert big chunks of data, and I see that the fastinsert is really slow. Even now I received this message:

java.lang.OutOfMemoryError: Java heap space
at java.io.BufferedWriter.<init>(Unknown Source)
at java.io.BufferedWriter.<init>(Unknown Source)
at java.io.PrintWriter.<init>(Unknown Source)
at com.mathworks.jmi.OpaqueJavaInterface.getExceptionMessage(OpaqueJavaInterface.java:1313)
??? Failed to retrieve Exception Message

Does anyone know how to improve the fast insert. Some parameter that can help in sending it in series and not waiting to send the data. My autocommit is on, so I expected to dont store the process in the memory.

On the other hand, if no solution is possible, how can I calculate the maximum number of records I can try to insert at once. And if the exact number is not possible, how can I make it do the process in serial and not wait till he tries to keep al in memory (without needing to iterate my code one by one).

Any info is appreciated.

K E

unread,
Dec 18, 2009, 1:06:05 PM12/18/09
to

> On the other hand, if no solution is possible, how can I calculate the maximum number of records I can try to insert at once. And if the exact number is not possible, how can I make it do the process in serial and not wait till he tries to keep al in memory (without needing to iterate my code one by one).

Sorry no solution, but I am having the same problem when I try to read in data from a database. I keep reducing the number of records requested and it keeps crashing,

java.lang.OutOfMemoryError: Java heap space

So it would be nice to have a way to know exactly how many records I should request.

Oleg Komarov

unread,
Dec 18, 2009, 1:19:04 PM12/18/09
to

I'm really interested in this subject too. If somebody from TMW can help...

fastinsert 'is known' to be slow...I usually write data to .txt in delimited fmt and import it with the tools suplpied with the database software. Proved to be faster.

0 new messages