Too much memory consumption after multiple insertions

[Sotiris Beis]

Hi,

I have the following code: http://codeviewer.org/view/code:3b21 . 

I want to measure the time for the insertion of a block, where the block is consisted from 1,000 nodes and the corresponding edges. To be more clear my dataset is an edge list and when I find a new node I add to the database. Every line is an edge so in every line I add and edge. When 1,000 nodes have added I print the needed time. I want to commit every time a node or edge is added, in order to simulate a single insertion. My problem is that the memory consumption is too much. It needs more that 3GB of ram for a graph of approximately 403,394 nodes and 3,387,388 edges. I think that the problem comes from the index that is stored in memory. Is there any better way?

Thanks in advance.

[Andrey Lomakin]

Hi,

If you need you can decrease  memory consumption using following parameter storage.diskCache.bufferSize , if you use plocal storage.

--
 
---
You received this message because you are subscribed to the Google Groups "OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to orient-databa...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--

Best regards,
Andrey Lomakin.

Orient Technologies
the Company behind OrientDB

[Andrey Lomakin]

This parameter set db cache memory consumption in megabytes, so you can use set it to reasonable value.

[Sotiris Beis]

How can I determine wether my value is reasonable or not?

You received this message because you are subscribed to a topic in the Google Groups "OrientDB" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/orient-database/GWyoLB_nmAQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to orient-databa...@googlegroups.com.

[Andrey Lomakin]

Hi

I mean you should give DB as much RAM as possible without using of swap.

[Sotiris Beis]

Ok Andrey thank you.