How to determine the exact number of cuboids ( dimension combination) that will be generated .
10 views
Skip to first unread message
Puneet Gupta
May 27, 2015, 4:11:09 AM5/27/15
to kylin...@googlegroups.com
Hi ,
Is there any log message that i can look for to determine the exact number of cuboids ( dimension combination) that will be generated .
I have a small Fact table with 10,000 rows . The number of dimensions are 11.
When I arrange the dimensions such that 2 are of type "column" and 9 are of type "derived" and I choose cube size ="small" in GUI , i get close to 830,000 rows in HBase Aggregate/Cuboids table.
When I arrange the dimensions such that 2 are of type "Hierarchy" (Hierarchy1 has 4 levels Year,month,day,hour and Hirerachy2 has 2 levels Protocol Category and Protocol), 2 are of type "column" and rest are of type "derived" and I choose cube size ="small" in GUI , i get close to 2,000,000 rows in HBase Aggregate/Cuboids table.
In both cases i selected Dictionary compression for row keys
I wanted to control how many aggregates get generated. I feel the size of aggregate table is too high .
Any suggestions ?
Is there any log message that i can look for to determine the exact number of cuboids ( dimension combination) that will be generated .
I have a small Fact table with 10,000 rows . The number of dimensions are 11.
When I arrange the dimensions such that 2 are of type "column" and 9 are of type "derived" and I choose cube size ="small" in GUI , i get close to 830,000 rows in HBase Aggregate/Cuboids table.
When I arrange the dimensions such that 2 are of type "Hierarchy" (Hierarchy1 has 4 levels Year,month,day,hour and Hirerachy2 has 2 levels Protocol Category and Protocol), 2 are of type "column" and rest are of type "derived" and I choose cube size ="small" in GUI , i get close to 2,000,000 rows in HBase Aggregate/Cuboids table.
In both cases i selected Dictionary compression for row keys
I wanted to control how many aggregates get generated. I feel the size of aggregate table is too high .
Any suggestions ?
Reply all
Reply to author
Forward
This conversation is locked
You cannot reply and perform actions on locked conversations.
0 new messages