Go Back   CORTEX Forums > Reference Shelf > CAG - CORTEX Analytic Glossary > F - I
Register Blogs FAQ Members List Calendar Search Today's Posts Mark Forums Read

Grain

This is a discussion on Grain within the F - I forums, part of the CAG - CORTEX Analytic Glossary category; Is the term used to describe the level at which you store data in the business intelligence platform. A generally accepted principle of data warehousing is that you capture from ...


Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old 26th January 2010, 02:04 PM   #1
Administrator
 
Join Date: Oct 2007
Posts: 15,930
Blog Entries: 7
admin has disabled reputation
Post Grain

Is the term used to describe the level at which you store data in the business intelligence platform. A generally accepted principle of data warehousing is that you capture from source systems data at the lowest level possible because it is easier to summarise (or aggregate) data than to disaggregate it.

For example, it is preferable to capture all components of transactions (such as the cost of a subscription, the agent fee, and GST separately) rather than simply the total amount. In this example, the former components are called the ‘lowest level of grain’ and the later is an ‘aggregate’.

In data marts, the lower levels of grain are often available at summary levels because doing so makes queries much, much faster and it is a business requirement to provide summary data – so it makes sense to do it once when the data mart is refreshed (with new data) rather than each time a user requires it in when running a report.

Aggregates are a two-edged sword: they improve performance, but they take resources to build and maintain. The advice for the data warehousing team is generally to build aggregates where base data is dense (i.e. there is a lot of it), for frequently run queries, where the resulting aggregate is stable (meaning that is will not have to be changed often), and where the reduction in data volume is significant (that’s where the performance benefit is realised).

Refer also to Facts
admin is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
Reply

Bookmarks

Tags
grain
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Accumulating Snapshot Grain admin A - C 0 26th January 2010 08:55 AM


All times are GMT +11. The time now is 07:11 PM.

© The Business Intelligence Group

Search Engine Optimization by vBSEO