Neo4j Property Store

[Vaibhav Aiyar]

Hi,

When does NEO4j cleanup neostore.propertystore.db.strings store file.

We see huge variations in the size of the files in our three environments even though the node count and the data is similar.

Below are the sizes of this files in our three environments along with node counts

DEV: 19GB - 55699 nodes

TEST: 7.4GB - 184023 nodes

PROD: 700 MB - 258845 nodes

I deleted around 3000 Nodes is DEV which have the most number of properties and restarted NEO4j. 

I saw a reduction in the storage space for neostore.propertystore.db.strings.id but no change in neostore.propertystore.db.strings.

[Michael Hunger]

I don't think disk space is freed, just the blocks marked as unused.

And the restart will start using those blocks (for nodes and rels)

For properties etc. the blocks will be reused directly.

M

--
You received this message because you are subscribed to the Google Groups "Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email to neo4j+un...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Vaibhav Aiyar]

Would that not be a waste of space? Why would it need 19G if all it needs is to mark the blocks unused if there is no data?

We are concerned that the size may have increased due to some corruption in the files. 

We wanted to load the entire graph into memory to improve performance and 19G is too large.

[Michael Hunger]

You can run a consistency check on your graph:

http://www.markhneedham.com/blog/2014/01/22/neo4j-backup-store-copy-and-consistency-check/

You can use my StoryCopy tool to migrate/compact your store:

https://github.com/jexp/store-utils

HTH

Michael

[Vaibhav Aiyar]

Hi,

Is there anyway to compact the store without having to shutdown NEO4J. Or is there a way to configure NEO4J to actually free up space after a given time period

[Michael Hunger]

Is it the actual store that's keeping the space or tx logs?

neo4j marks records as unused to reuse them but doesn't currently free space on disk.

with my store-utils you can compact it but that's an offline tool.

Join our new Community Site & Forum