Empty folder time to time

[A BOUZINAC]

Hello

Is there a possibility to, when Openrefine starts, propose to delete big old projects/clean old projects ? (would help improve memory) ?

Thanks

Alexis

[Thad Guidry]

Hi Alexis,

OpenRefine does not use much RAM at all when it first starts and you see the Project screen in your browser showing the listing of previous projects and tags.

It does much more RAM once you click to open a previous project which will open it in memory and includes all previous transformations done on that project.

Many folks will load one of their large projects and just do an export on their project that has been cleaned and transformed heavily into a format (CSV, TSV, etc.) of their choosing and then Create a new Project in OpenRefine with that newly exported file.  Then they will delete the older project if not really needed for provenance.

Doing those steps would basically throw away the History of Changes you made in the original project.

Again, memory is really only used once you open a project and see the data grid.  If you open several projects in different browser tabs, those all will use memory at the same time, and will only release the memory back to your system (the Java heap) after about 1 hour (maybe it's 30 minutes now? forgot) of inactivity on that project.

Thad

https://www.linkedin.com/in/thadguidry/

https://calendly.com/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/031cf125-a521-4270-83de-5f00415ec4d5n%40googlegroups.com.

[A BOUZINAC]

Hi, it appears that my OR (3.5.1.) reacts much better after having cleaned and deleted old projects.

Sincerely,

Alexis

You received this message because you are subscribed to a topic in the Google Groups "OpenRefine Development" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/openrefine-dev/81r1N5ZOwYU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to openrefine-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/CAChbWaPocZDEZ6NgkD8SXWXiROoGwAmvWD4OopQqT68ALzOo4g%40mail.gmail.com.

[Thad Guidry]

Alexis,

Then I don't know what would be happening there if you just started OpenRefine 3.5.1 and looking only at the Project screen (and not clicked on anything).

On my Windows 10 system, OpenRefine has a workspace I point it to with about 120 projects... at which point OpenRefine is showing it is only using about 354 megabytes as shown in my Task Manager:

Thad

https://www.linkedin.com/in/thadguidry/

https://calendly.com/thadguidry/

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/CAB%3DdFj3uXTAYUxSzcCTopOSCipN0QArbDXPm_axnCmnaCgDhwA%40mail.gmail.com.

[A BOUZINAC]

Then perhaps another idea : I noticed a very very long name of project filled with bizarre characters/bad encoded characters. Perhaps, the file directory was behaving better after having deleted it? 

I have unfortunately no screenshot of that bizarre name project.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/CAChbWaOdFWr0Gk-q49ACbWYvLo6yVyxeXpJNXgeO6WEur0vq-w%40mail.gmail.com.

[Thad Guidry]

Hi Alexis,
That sounds like a likely scenario that might have contributed to some memory usage overhead.

Thad

https://www.linkedin.com/in/thadguidry/

https://calendly.com/thadguidry/

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/CAB%3DdFj2xnTcEca9SE4pmumtSS1d5NMN527j_qhFz8TRz%3DsRDcQ%40mail.gmail.com.