newbie questions about kdb

135 views
Skip to first unread message

kjackson

unread,
Oct 21, 2010, 4:21:41 PM10/21/10
to Kdb+ Personal Developers
I'm a complete newbie to kdb. As a hobby, I am currently developing
my own analysis software using a SQL server backend. I have roughly
120 GB worth of tick data.

I've been reading good things about kdb, so I decided to check it out,
and if it works better I was thinking of migrating to it.. I
downloaded the trial software, but the website is rather sparse...
also, it seems to be tiny, less than 1 MB and only a form of CLI.
Did I download the right software?

If so, will the trial software allow me to import 120 GB of data?

Thanks in advance,

Ken

Aaron Davies

unread,
Oct 21, 2010, 8:11:13 PM10/21/10
to personal...@googlegroups.com
That's the right software, it's runnable as a REPL or an interpreter
for script files. The trial version has some limitations, which I
don't remember off the top of my head; I'm not sure whether they'll
affect you.

100GB will almost certainly need to be stored as a partitioned
database (details in the wiki at code.kx.com), and you'll probably
need to write some sort of ETL program to get your data into the right
format. (It should be about 10 lines.)

> --
> You received this message because you are subscribed to the Google Groups "Kdb+ Personal Developers" group.
> To post to this group, send email to personal...@googlegroups.com.
> To unsubscribe from this group, send email to personal-kdbpl...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/personal-kdbplus?hl=en.
>
>

--
Aaron Davies
aaron....@gmail.com

Fintan Quill

unread,
Oct 21, 2010, 8:28:54 PM10/21/10
to personal...@googlegroups.com
Hello Ken,

Further to Aaron's advice, the trial software is only available in
32-bit, so you'll have the RAM restriction imposed by 32-bit
addressability, which could inhibit your data import. If you search
through this group you'll find the other trial software restrictions.

The following link may be of use to you when importing the data:

https://code.kx.com/trac/wiki/KdbplusForMortals/dotQ_utilities#a1.5.5.Q.fs

user/pass:anonymous/anonymous

Regards,

Fintan.

kjackson

unread,
Oct 22, 2010, 4:47:24 PM10/22/10
to Kdb+ Personal Developers
Great, thanks to both of you for the info! I will look this up
further and try to get it up and running.

On Oct 21, 5:28 pm, Fintan Quill <fint...@gmail.com> wrote:
> Hello Ken,
>
> Further to Aaron's advice, the trial software is only available in
> 32-bit, so you'll have the RAM restriction imposed by 32-bit
> addressability, which could inhibit your data import. If you search
> through this group you'll find the other trial software restrictions.
>
> The following link may be of use to you when importing the data:
>
> https://code.kx.com/trac/wiki/KdbplusForMortals/dotQ_utilities#a1.5.5...
>
> user/pass:anonymous/anonymous
>
> Regards,
>
> Fintan.
>
>
>
> On Thu, Oct 21, 2010 at 8:11 PM, Aaron Davies <aaron.dav...@gmail.com> wrote:
> > That's the right software, it's runnable as a REPL or an interpreter
> > for script files. The trial version has some limitations, which I
> > don't remember off the top of my head; I'm not sure whether they'll
> > affect you.
>
> > 100GB will almost certainly need to be stored as a partitioned
> > database (details in the wiki at code.kx.com), and you'll probably
> > need to write some sort of ETL program to get your data into the right
> > format. (It should be about 10 lines.)
>
> > On Thursday, October 21, 2010, kjackson <kjackson....@gmail.com> wrote:
> >> I'm a complete newbie to kdb.  As a hobby, I am currently developing
> >> my own analysis software using a SQL server backend.  I have roughly
> >> 120 GB worth of tick data.
>
> >> I've been reading good things about kdb, so I decided to check it out,
> >> and if it works better I was thinking of migrating to it..  I
> >> downloaded the trial software, but the website is rather sparse...
> >> also, it seems to be tiny, less than 1 MB and only a form of CLI.
> >> Did  I download the right software?
>
> >> If so, will the trial software allow me to import 120 GB of data?
>
> >> Thanks in advance,
>
> >> Ken
>
> >> --
> >> You received this message because you are subscribed to the Google Groups "Kdb+ Personal Developers" group.
> >> To post to this group, send email to personal...@googlegroups.com.
> >> To unsubscribe from this group, send email to personal-kdbpl...@googlegroups.com.
> >> For more options, visit this group athttp://groups.google.com/group/personal-kdbplus?hl=en.
>
> > --
> > Aaron Davies
> > aaron.dav...@gmail.com
Reply all
Reply to author
Forward
0 new messages