Data granularity over time (sensei-ba)

[Lerchmo]

One of the nice features of Druid is the automatic expiration of data resolution based on timestamp. Is there a way to over-write granular data in sensei-ba with map reduce, without taking the system offline? like push segments of hourly rollups on-top of raw data? 

how would you recommend achieving that behavior on Sensei-BA ? Thanks!

[Volodymyr Zhabiuk]

Hi Derek

SenseiBA supports  data expiration both for realtime and offline clusters. 

As for replacing segments of hour granularity with ones of daily or weekly, the design for this feature is ready. We are thinking about the transaction support where we can atomically swap the set of segments with another set. We haven't implemented it yet, as we don't need this feature right away. 

But I think it should be ready in two weeks

Thanks,

Volodymyr

2013/4/4 Lerchmo <de...@eclipse.io>

One of the nice features of Druid is the automatic expiration of data resolution based on timestamp. Is there a way to over-write granular data in sensei-ba with map reduce, without taking the system offline? like push segments of hourly rollups on-top of raw data? 

how would you recommend achieving that behavior on Sensei-BA ? Thanks!

--
You received this message because you are subscribed to the Google Groups "Sensei" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sensei-searc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Volodymyr Zhabiuk]

Hi Derek

The feature is ready it's called 'Atomic swap'. This week I will create documentation for this

With many thanks,

Volodymyr

2013/4/4 Lerchmo <de...@eclipse.io>

To unsubscribe from this group and stop receiving emails from it, send an email to sensei-search+unsubscribe@googlegroups.com.

[Volodymyr Zhabiuk]

Here is the documentation - http://sensei-ba.github.io/sensei-ba/atomicSwap.html . I've uploaded the new version of the SenseiBA tarball that has this functionality

BTW code was migrated to the new repository. 

Thanks,

Volodymyr

2013/5/7 Volodymyr Zhabiuk <vzha...@gmail.com>

To unsubscribe from this group and stop receiving emails from it, send an email to sensei-searc...@googlegroups.com.

[Volodymyr Zhabiuk]

Forgot to mention the path to the repository - https://github.com/sensei-ba/sensei-ba

2013/5/9 Volodymyr Zhabiuk <vzha...@gmail.com>