Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
multi-threaded processing of dimensions
0 views
Skip to first unread message
bob
Dec 10, 2009, 8:05:26 AM12/10/09
to
i have AS hardware with 32 cpus and 256gb of ram. when dimension
processing starts, i probably see 50 to 60% utilization which is fine
(it goes down over time, but thats because it is completing the
dimensions and only the long running ones are left). the basic
refresh and "updating" of new members probably takes about 30 minutes,
however dimensions processing continues by "touching" all the cubes
partitions. This cube has a 100 + daily partitions and a number of
flexible attribute relationships in my dimensions. what i notice is
that during dimension processing (not fact processing), each of the
100 partitions is "processed" (at least that is what i see in BIDS
during a dimensions process update). I believe this activity has to
do with bit map indexes being invalidated due to changes in particular
dimension flexible attributes. The problem is the time it takes to
complete the entire Dimensions Processing activity... it takes over 4
hours to "touch" each of these partitions and finish the Dimensions
processing step. But my real concern is why this partition activity
is not multi-threaded. as near as i can tell only one cpu
participates during this "touching" of the partitions. i have 31
processors sitting virtual idle while one of them cranks at 100%.
There is no network traffic during this process. thanks for any
insight
processing starts, i probably see 50 to 60% utilization which is fine
(it goes down over time, but thats because it is completing the
dimensions and only the long running ones are left). the basic
refresh and "updating" of new members probably takes about 30 minutes,
however dimensions processing continues by "touching" all the cubes
partitions. This cube has a 100 + daily partitions and a number of
flexible attribute relationships in my dimensions. what i notice is
that during dimension processing (not fact processing), each of the
100 partitions is "processed" (at least that is what i see in BIDS
during a dimensions process update). I believe this activity has to
do with bit map indexes being invalidated due to changes in particular
dimension flexible attributes. The problem is the time it takes to
complete the entire Dimensions Processing activity... it takes over 4
hours to "touch" each of these partitions and finish the Dimensions
processing step. But my real concern is why this partition activity
is not multi-threaded. as near as i can tell only one cpu
participates during this "touching" of the partitions. i have 31
processors sitting virtual idle while one of them cranks at 100%.
There is no network traffic during this process. thanks for any
insight
bob
Dec 12, 2009, 7:45:19 AM12/12/09
to
btw- this is Analysis Services 2005
0 new messages