Hi all, anyway to monitor the process when importing a large file to stardog?Best,
--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
stardog+u...@clarkparsia.com
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+u...@clarkparsia.com.
> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Stardog" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to stardog+unsubscribe@clarkparsia.com.
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+unsubscribe@clarkparsia.com.
Direct download http://download.geonames.org/all-geonames-rdf.zip
File: all-geonames-rdf.zip
Date: (2016 02 26)
File size: 603M
Sha1: abb9d8e13b1cb0b659422dfa804fcfe3a675cac3#!/bin/bash
while read file; do
rapper --quiet <(echo $file) 2> errors
done < <(awk ‘NR % 2 == 0 { print; }’ $*)File Size Summary
-rw-rw-r--. 1 zcw100 zcw100 18G May 28 00:55 geonames-20160226.nt
-rw-rw-r--. 1 zcw100 zcw100 556M May 28 13:01 geonames-20160226.nt.bz2
-rw-rw-r--. 1 zcw100 zcw100 1.1G May 28 12:57 geonames-20160226.nt.gz
-rw-rw-r--. 1 zcw100 zcw100 680M Sep 18 16:03 geonames-20160226.nt.xz
-rw-rw-r--. 1 zcw100 zcw100 1.1G Sep 18 14:49 geonames-20160226.nt.zip
-rw-rw-r--. 1 zcw100 zcw100 18G May 28 14:14 geonames-20160226.rdf
-rw-rw-r--. 1 zcw100 zcw100 329M Sep 18 16:00 geonames-20160226.rdf.bz2
-rw-rw-r--. 1 zcw100 zcw100 598M Sep 18 15:06 geonames-20160226.rdf.gz
-rw-rw-r--. 1 zcw100 zcw100 467M Sep 18 17:45 geonames-20160226.rdf.xz
-rw-rw-r--. 1 zcw100 zcw100 598M Sep 18 15:05 geonames-20160226.rdf.zip
-rw-rw-r--. 1 zcw100 zcw100 12G May 28 12:41 geonames-20160226.ttl
-rw-rw-r--. 1 zcw100 zcw100 312M May 28 13:21 geonames-20160226.ttl.bz2
-rw-rw-r--. 1 zcw100 zcw100 562M May 28 12:37 geonames-20160226.ttl.gz
-rw-rw-r--. 1 zcw100 zcw100 418M May 28 13:39 geonames-20160226.ttl.xz
-rw-rw-r--. 1 zcw100 zcw100 563M May 28 12:53 geonames-20160226.ttl.zip
-rw-rw-r--. 1 zcw100 zcw100 15G Sep 18 17:03 geonames-20160226.txt
-rw-rw-r--. 1 zcw100 zcw100 346M Sep 18 17:44 geonames-20160226.txt.bz2
-rw-rw-r--. 1 zcw100 zcw100 604M Sep 18 17:07 geonames-20160226.txt.gz
-rw-rw-r--. 1 zcw100 zcw100 424M Sep 18 17:44 geonames-20160226.txt.xz
-rw-rw-r--. 1 zcw100 zcw100 604M Sep 18 17:06 geonames-20160226.txt.zip
Bulk Loading
nt
stardog-admin db create -n geonames geonames-20160226.nt
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:16:04.663 @ 168.4K triples/sec.
nt (split into 16 files)
stardog-admin db create -n geonames *.nt
Loaded 162,474,860 triples to geonames from 17 file(s) in 00:12:17.478 @ 220.3K triples/sec.
nt.gz
Stardog-admin db create -n geonames geonames-20160226.nt.gz
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:14:51.904 @ 182.2K triples/sec.
ttl.gz
stardog-admin db create -n geonames geonames-20160226.ttl.gz
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:12:30.565 @ 216.5K triples/sec.
rdf
Stardog-admin db create-n geonames geonames-20160226.rdf
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:11:43.014 @ 231.1K triples/sec.
rdf.gz
Stardog-admin db create -n geonames geonames-20160226.rdf.gz
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:13:13.577 @ 204.7K triples/sec.
ttl.gz (index triples only)
Stardog-admin db create -n geonames --index-triples-only geonames-20160226.ttl.gz
Loaded 162,474,860 triples to geonames from 1 file(s) in 00:11:21.923 @ 238.3K triples/sec.
Loading (after db creation)
Stardog-admin db create -n geonames
Stardog data add geonames geonames-20160226.nt
Added 162,474,860 triples in 00:16:08.903
System info
cpu: Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz
Memory : 16Gb
SSD drive
STARDOG_JAVA_ARGS=-Xms4g -Xmx4g -XX:MaxDirectMemorySize=4g
Stardog 4.1.2
>>> > For more options, visit this group at
>>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>> > ---
>>> > You received this message because you are subscribed to the Google
>>> > Groups
>>> > "Stardog" group.
>>> > To unsubscribe from this group and stop receiving emails from it, send
>>> > an
>>> > email to stardog+unsubscribe@clarkparsia.com.
>>> >
>>> > --
>>> > -- --
>>> > You received this message because you are subscribed to the C&P
>>> > "Stardog"
>>> > group.
>>> > To post to this group, send email to sta...@clarkparsia.com
>>> > To unsubscribe from this group, send email to
>>> > For more options, visit this group at
>>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>
>>> --
>>> -- --
>>> You received this message because you are subscribed to the C&P "Stardog"
>>> group.
>>> To post to this group, send email to sta...@clarkparsia.com
>>> To unsubscribe from this group, send email to
>>> For more options, visit this group at
>>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>> ---
>>> You received this message because you are subscribed to the Google Groups
>>> "Stardog" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an
>>> email to stardog+unsubscribe@clarkparsia.com.
>>>
>>
>> --
>> -- --
>> You received this message because you are subscribed to the C&P "Stardog"
>> group.
>> To post to this group, send email to sta...@clarkparsia.com
>> To unsubscribe from this group, send email to
>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+unsubscribe@clarkparsia.com.
I should add that I was also surprised that that fastest load was uncompressed RDF/XML.
>>>> >>> > stardog+unsubscribe@clarkparsia.com
>>>> >>> > For more options, visit this group at
>>>> >>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>> > ---
>>>> >>> > You received this message because you are subscribed to the Google
>>>> >>> > Groups
>>>> >>> > "Stardog" group.
>>>> >>> > To unsubscribe from this group and stop receiving emails from it,
>>>> >>> > send
>>>> >>> > an
>>>> >>> > email to stardog+unsubscribe@clarkparsia.com.
>>>> >>> >
>>>> >>> > --
>>>> >>> > -- --
>>>> >>> > You received this message because you are subscribed to the C&P
>>>> >>> > "Stardog"
>>>> >>> > group.
>>>> >>> > To post to this group, send email to sta...@clarkparsia.com
>>>> >>> > To unsubscribe from this group, send email to
>>>> >>> > stardog+unsubscribe@clarkparsia.com
>>>> >>> > For more options, visit this group at
>>>> >>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>>
>>>> >>> --
>>>> >>> -- --
>>>> >>> You received this message because you are subscribed to the C&P
>>>> >>> "Stardog"
>>>> >>> group.
>>>> >>> To post to this group, send email to sta...@clarkparsia.com
>>>> >>> To unsubscribe from this group, send email to
>>>> >>> stardog+unsubscribe@clarkparsia.com
>>>> >>> For more options, visit this group at
>>>> >>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>> ---
>>>> >>> You received this message because you are subscribed to the Google
>>>> >>> Groups
>>>> >>> "Stardog" group.
>>>> >>> To unsubscribe from this group and stop receiving emails from it,
>>>> >>> send an
>>>> >>> email to stardog+unsubscribe@clarkparsia.com.
>>>> >>>
>>>> >>
>>>> >> --
>>>> >> -- --
>>>> >> You received this message because you are subscribed to the C&P
>>>> >> "Stardog"
>>>> >> group.
>>>> >> To post to this group, send email to sta...@clarkparsia.com
>>>> >> To unsubscribe from this group, send email to
>>>> >> For more options, visit this group at
>>>> >> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>
>>>> --
>>>> -- --
>>>> You received this message because you are subscribed to the C&P
>>>> "Stardog" group.
>>>> To post to this group, send email to sta...@clarkparsia.com
>>>> To unsubscribe from this group, send email to
>>>> For more options, visit this group at
>>>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Stardog" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to stardog+unsubscribe@clarkparsia.com.
>>>>
>>>
>>
>> --
>> -- --
>> You received this message because you are subscribed to the C&P "Stardog"
>> group.
>> To post to this group, send email to sta...@clarkparsia.com
>> To unsubscribe from this group, send email to
>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Stardog" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to stardog+unsubscribe@clarkparsia.com.
>
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+unsubscribe@clarkparsia.com.
>>>> >>> > stardog+unsubscribe@clarkparsia.com
>>>> >>> > For more options, visit this group at
>>>> >>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>> > ---
>>>> >>> > You received this message because you are subscribed to the Google
>>>> >>> > Groups
>>>> >>> > "Stardog" group.
>>>> >>> > To unsubscribe from this group and stop receiving emails from it,
>>>> >>> > send
>>>> >>> > an
>>>> >>> > email to stardog+unsubscribe@clarkparsia.com.
>>>> >>> >
>>>> >>> > --
>>>> >>> > -- --
>>>> >>> > You received this message because you are subscribed to the C&P
>>>> >>> > "Stardog"
>>>> >>> > group.
>>>> >>> > To post to this group, send email to sta...@clarkparsia.com
>>>> >>> > To unsubscribe from this group, send email to
>>>> >>> > stardog+unsubscribe@clarkparsia.com
>>>> >>> > For more options, visit this group at
>>>> >>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>>
>>>> >>> --
>>>> >>> -- --
>>>> >>> You received this message because you are subscribed to the C&P
>>>> >>> "Stardog"
>>>> >>> group.
>>>> >>> To post to this group, send email to sta...@clarkparsia.com
>>>> >>> To unsubscribe from this group, send email to
>>>> >>> stardog+unsubscribe@clarkparsia.com
>>>> >>> For more options, visit this group at
>>>> >>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> >>> ---
>>>> >>> You received this message because you are subscribed to the Google
>>>> >>> Groups
>>>> >>> "Stardog" group.
>>>> >>> To unsubscribe from this group and stop receiving emails from it,
>>>> >>> send an
>>>> >>> email to stardog+unsubscribe@clarkparsia.com.
>>>> >>>
>>>> >>
>>>> >> --
>>>> >> -- --
>>>> >> You received this message because you are subscribed to the C&P
>>>> >> "Stardog"
>>>> >> group.
>>>> >> To post to this group, send email to sta...@clarkparsia.com
>>>> >> To unsubscribe from this group, send email to
>>>> >> For more options, visit this group at
>>>> >> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>
>>>> --
>>>> -- --
>>>> You received this message because you are subscribed to the C&P
>>>> "Stardog" group.
>>>> To post to this group, send email to sta...@clarkparsia.com
>>>> To unsubscribe from this group, send email to
>>>> For more options, visit this group at
>>>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Stardog" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to stardog+unsubscribe@clarkparsia.com.
>>>>
>>>
>>
>> --
>> -- --
>> You received this message because you are subscribed to the C&P "Stardog"
>> group.
>> To post to this group, send email to sta...@clarkparsia.com
>> To unsubscribe from this group, send email to
>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Stardog" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to stardog+unsubscribe@clarkparsia.com.
>
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+unsubscribe@clarkparsia.com.