Change the creation of the rows in HBase from hour to dat

29 views
Skip to first unread message

spico...@gmail.com

unread,
Oct 8, 2015, 11:19:57 AM10/8/15
to OpenTSDB
Hello!
By default OpenTSDB creates a new row per time series per hour. It is possible to change this policy, to create a new row by day for example? If yes, how?
I look forward for your answers. Thank you.
 Rgards,
 Florin

John A. Tamplin

unread,
Oct 8, 2015, 11:23:48 AM10/8/15
to spico...@gmail.com, OpenTSDB
On Thu, Oct 8, 2015 at 11:19 AM, <spico...@gmail.com> wrote:
By default OpenTSDB creates a new row per time series per hour. It is possible to change this policy, to create a new row by day for example? If yes, how?
I look forward for your answers. Thank you.

Sure, but it will require a lot of code changes.  Also, if you are storing millisecond-level entries, your rows will be way too large - you probably need to be storing no more than a few values per minute for this to be reasonable.  There will also be some implications on how compactions are performed, meaning the compaction queue will get 24x larger.

--
John A. Tamplin

spico...@gmail.com

unread,
Oct 8, 2015, 12:26:16 PM10/8/15
to OpenTSDB, spico...@gmail.com
Hi! 
Thank you very much for your  answer. It is very clear what involves this requirement.
Best regards,
  Florin 

ManOLamancha

unread,
Nov 10, 2015, 6:36:14 PM11/10/15
to OpenTSDB, spico...@gmail.com
On Thursday, October 8, 2015 at 9:26:16 AM UTC-7, spico...@gmail.com wrote:
Hi! 
Thank you very much for your  answer. It is very clear what involves this requirement.

John's right that it's a pain but it's something I've been toying with via rollups and some other folks would like to change the row schema to gracefully handle less frequent data. I'll work on generalizing the code and maybe it can come into 2.4. 
Reply all
Reply to author
Forward
0 new messages