Load time

[Ryan D'souza]

HI,

  Do we have to create a schema in such a way that the time taken to load the data is as low as possible ?. Cause for my current BaseX logical schema structure the load time particularly during the create friend action is very high. However if I change the schema to drastically reduce load time I observe that the time to query is much higher that what is was earlier. So do I concentrate on low load times or read time ?

Regards,

Ryan

[Shahram Ghandeharizadeh]

Hi,
We discussed this in person and here is a brief summary:

- Typically, constructing indexes after the schema has been populated results in a faster load time.
- It is important to analyze the utilization of resources (such as CPU, disk, and network if the BGClient and the data store are hosted on different nodes) and, if the resources are idle, to configure BG to use multiple threads to load the data store.

Shahram.

--
You received this message because you are subscribed to the Google Groups "BG Social Benchmark" group.
To unsubscribe from this group and stop receiving emails from it, send an email to BG-SocialBenchm...@googlegroups.com.
Visit this group at http://groups.google.com/group/BG-SocialBenchmark.
For more options, visit https://groups.google.com/groups/opt_out.

[Nguyen Trung Hieu]

Hi,

You can try these settings to make the loading time faster. It took me 5000 seconds instead of 10 hours to load 10k members with 12Kb profile images.

- At the BG Client, change the number of threads to 100

At the Basex Server:

- set TEXTINDEX to false

- set AUTOFLUSH to false (so before closing connection, execute the flush command to make sure that all the updates on data are written back to the disk)

- set PARALLEL to 16