Does blueflood support the different granularity rollups?
116 views
Skip to first unread message
Yiwei Chen
Aug 25, 2015, 9:13:25 PM8/25/15
to Blueflood Discuss
Hi there,
Recently, I started to use blueflood to finish some work of my project, it works really great as I previously knew.
Now I want to have a 1min granularity rollup (much shorter than default 5min), but when I looked into the code, I found the rollup thread runs per minute, and spends 1min for each rollup round.
Does that mean blueflood cannot do any rollups with the granularity less than 1min? I did not finish reading the code, so just want to ask you guys first about this.
Thanks,
Yiwei
Sri Harsha
Jun 13, 2016, 4:58:47 PM6/13/16
to Blueflood Discuss
Hi Yiewi, I got a similar requirement and I have been scribbing my head on the same. Did you find any possible/possible solution/approach for the same.. Please let me know.
Richard Sartor
Jun 22, 2016, 2:58:31 PM6/22/16
to Blueflood Discuss
Hi, Yiwei.
The short answer to your question is "no". Blueflood only supports a fixed number of rollup granularities. Currently, there is nothing between the 5-minute and full granularities. To add a one-minute granularity would take considerable effort and testing.
Also, as you found out, there are a number of places in the source code where thread timing and synchronization are hard-coded. For example, the BluefloodServicestart class will schedule recurring tasks that update the ScheduleContext time, at intervals of 500 milliseconds (see here: https://github.com/rackerlabs/blueflood/blob/500bbd9d1341efb8193a8e6e674b2ca034bba343/blueflood-core/src/main/java/com/rackspacecloud/blueflood/service/BluefloodServiceStarter.java#L201 ). Changing that value would also require lots of testing.
There are also configurable timings. The RollupService class repeatedly polls the database to schedule eligible slots, at an interval that can be customized by changing the SCHEDULE_POLL_PERIOD config variable (default 60 seconds) in the configuration file (see https://github.com/rackerlabs/blueflood/blob/500bbd9d1341efb8193a8e6e674b2ca034bba343/blueflood-core/src/main/java/com/rackspacecloud/blueflood/service/RollupService.java#L92 ).
Unfortunately, there is no easy way to run one-minute granularity rollups at this time.
The short answer to your question is "no". Blueflood only supports a fixed number of rollup granularities. Currently, there is nothing between the 5-minute and full granularities. To add a one-minute granularity would take considerable effort and testing.
Also, as you found out, there are a number of places in the source code where thread timing and synchronization are hard-coded. For example, the BluefloodServicestart class will schedule recurring tasks that update the ScheduleContext time, at intervals of 500 milliseconds (see here: https://github.com/rackerlabs/blueflood/blob/500bbd9d1341efb8193a8e6e674b2ca034bba343/blueflood-core/src/main/java/com/rackspacecloud/blueflood/service/BluefloodServiceStarter.java#L201 ). Changing that value would also require lots of testing.
There are also configurable timings. The RollupService class repeatedly polls the database to schedule eligible slots, at an interval that can be customized by changing the SCHEDULE_POLL_PERIOD config variable (default 60 seconds) in the configuration file (see https://github.com/rackerlabs/blueflood/blob/500bbd9d1341efb8193a8e6e674b2ca034bba343/blueflood-core/src/main/java/com/rackspacecloud/blueflood/service/RollupService.java#L92 ).
Unfortunately, there is no easy way to run one-minute granularity rollups at this time.
Reply all
Reply to author
Forward
0 new messages