How do I configure in-memory storage?

[Stefan Arentz]

Is it possible to run Cleo completely from in-memory storage only? I am not interested in persisting data on disk.

I see a MemoryConnectionsStore but where would I configure Cleo to use that?

 S.

[Jingwei]

Hi Stefan,

It is not possible at the present time to configure Cleo use pure memory store without any persistence support, unless that you create new ConnectionsStore class.

Cheers.

Jingwei

[Stefan Arentz]

On Thu, Aug 16, 2012 at 7:37 PM, Jingwei <jingw...@gmail.com> wrote:

Hi Stefan,

 

It is not possible at the present time to configure Cleo use pure memory store without any persistence support, unless that you create new ConnectionsStore class.

Thanks Jinwei. I will give that a try.

Do you maybe have some general hints on speeding up the process of importing data?

I am trying to import 4.6 million Wikipedia page titles and I am getting about 250 inserts per second on a crazy high-end EC2 instance. (The one with 64GB of memory and 2TB of SSD)

 S.

[Jingwei]

Hi Stephan,

The current implementation of cleo is not really efficient at bootstrapping. I am working on some code to mitigate this effect. However, it will take some time.

Thanks.

Jingwei