Bulk loading data from text files?

45 views
Skip to first unread message

Andrew Swan

unread,
Jan 27, 2012, 5:51:39 AM1/27/12
to Scale 7 - Libraries and systems for scalable computing
I'm writing some integration tests for Pelops-based DAOs, and would
like to pre-populate my embedded Cassandra server with data from a
text file (of any format). Does Pelops provide anything like this?
There's the CassandraUnit project, but (a) it's based on Hector and
(b) its DataLoader class wants to create the keyspace etc., and my
test case already does that. I simply want some Pelops-based code that
can load data from a text file into one or more existing keyspaces and
column families.

Dan Washusen

unread,
Jan 27, 2012, 6:07:03 PM1/27/12
to sca...@googlegroups.com
Hi Andrew,
I'm guessing you've already noticed org.scale7.cassandra.pelops.support.AbstractIntegrationTest which provides the ability to spool up an embedded Cassandra instance with hooks to populate data.  It's included in the test jar that gets published with everything else…

I don't know of anything that loads data from a text file into cassandra that's based on Pelops…

Cheers,
-- 
Dan Washusen
Make big files fly

Andrew Swan

unread,
Jan 28, 2012, 3:19:28 AM1/28/12
to Scale 7 - Libraries and systems for scalable computing
Thanks Dan, I'll check it out. What are the Maven coordinates (G:A:V)
of that "test" JAR file please?

Andrew

On Jan 28, 10:07 am, Dan Washusen <d...@reactive.org> wrote:
> Hi Andrew,
> I'm guessing you've already noticed org.scale7.cassandra.pelops.support.AbstractIntegrationTest which provides the ability to spool up an embedded Cassandra instance with hooks to populate data.  It's included in the test jar that gets published with everything else…
>
> I don't know of anything that loads data from a text file into cassandra that's based on Pelops…
>
> Cheers,--
> Dan Washusen
> Make big files fly
> visit digitalpigeon.com (http://digitalpigeon.com)

Dan Washusen

unread,
Jan 29, 2012, 8:59:43 PM1/29/12
to sca...@googlegroups.com
Hi Andrew,
The test jar is published along with the main jar for every release - just add <classifier>tests</classifier> and you should be good to go…  Alternatively take a look at https://github.com/s7/mvnrepo/tree/master/org/scale7/scale7-pelops/1.3-1.0.x

Cheers,
-- 

Dan Washusen
Make big files fly
Reply all
Reply to author
Forward
0 new messages