Logo

Navigation
  • Home
  • Services
    • ERP Solutions
    • Implementation Solutions
    • Support and Maintenance Solutions
    • Custom Solutions
    • Upgrade Solutions
    • Training and Mentoring
    • Web Solutions
    • Production Support
    • Architecture Designing
    • Independent Validation and Testing Services
    • Infrastructure Management
  • Expertise
    • Microsoft Development Expertise
    • Mobile Development
    • SQL Server Database and BI
    • SAP BI, SAP Hana, SAP BO
    • Oracle and BI
    • Oracle RAC
  • Technical Training
    • Learn Data Management
      • Business Intelligence
      • Data Mining
      • Data Modeling
      • Data Warehousing
      • Disaster Recovery
    • Learn Concepts
      • Application Development
      • Client Server
      • Cloud Computing Tutorials
      • Cluster Computing
      • CRM Tutorial
      • EDI Tutorials
      • ERP Tutorials
      • NLP
      • OOPS
      • Concepts
      • SOA Tutorial
      • Supply Chain
      • Technology Trends
      • UML
      • Virtualization
      • Web 2.0
    • Learn Java
      • JavaScript Tutorial
      • JSP Tutorials
      • J2EE
    • Learn Microsoft
      • MSAS
      • ASP.NET
      • ASP.NET 2.0
      • C Sharp
      • MS Project Training
      • Silverlight
      • SQL Server 2005
      • VB.NET 2005
    • Learn Networking
      • Networking
      • Wireless
    • Learn Oracle
      • Oracle 10g
      • PL/SQL
      • Oracle 11g Tutorials
      • Oracle 9i
      • Oracle Apps
    • Learn Programming
      • Ajax Tutorial
      • C Language
      • C++ Tutorials
      • CSS Tutorial
      • CSS3 Tutorial
      • JavaScript Tutorial
      • jQuery Tutorial
      • MainFrame
      • PHP Tutorial
      • VBScript Tutorial
      • XML Tutorial
    • Learn Software Testing
      • Software Testing Types
      • SQA
      • Testing
  • Career Training
    • Career Improvement
      • Career Articles
      • Certification Articles
      • Conflict Management
      • Core Skills
      • Decision Making
      • Entrepreneurship
      • Goal Setting
      • Life Skills
      • Performance Development
      • Personal Excellence
      • Personality Development
      • Problem Solving
      • Relationship Management
      • Self Confidence
      • Self Supervision
      • Social Networking
      • Strategic Planning
      • Time Management
    • Education Help
      • Career Tracks
      • Essay Writing
      • Internship Tips
      • Online Education
      • Scholarships
      • Student Loans
    • Managerial Skills
      • Business Communication
      • Business Networking
      • Facilitator Skills
      • Managing Change
      • Marketing Management
      • Meeting Management
      • Process Management
      • Project Management
      • Project Management Life Cycle
      • Project Management Process
      • Project Risk Management
      • Relationship Management
      • Task Management
      • Team Building
      • Virtual Team Management
    • Essential Life Skills
      • Anger Management
      • Anxiety Management
      • Attitude Development
      • Coaching and Mentoring
      • Emotional Intelligence
      • Stress Management
      • Positive Thinking
    • Communication Skills
      • Conversation Skills
      • Cross Culture Competence
      • English Vocabulary
      • Listening Skills
      • Public Speaking Skills
      • Questioning Skills
    • Soft Skills
      • Assertive Skills
      • Influence Skills
      • Leadership Skills
      • Memory Skills
      • People Skills
      • Presentation Skills
    • Finding a Job
      • Etiquette Tips
      • Group Discussions
      • HR Interviews
      • Interview Notes
      • Job Search Tips
      • Resume Tips
      • Sample Resumes
 

MSAS: Analysis Server Cube Storage

By Exforsys | on April 12, 2005 |
MSAS

Online Analytical Processing (OLAP) is essentially data presented as Cubes, dimensions, hierarchies and measures. Users can navigate a complex set of data intuitively using these objects. In this context, consistent response times for each view or slice of data become important. Therefore modes of storing and retrieving data became the key tenet of storage design.

In the early days OLAP technology focused upon specialized, non-relational storage models as the only possible mode for OLAP. They called this technology Multidimensional OLAP(MOLAP). Later vendors discovered that the use of database structures(Star and snowflake schemas) helped in indexing, and storage of aggregates, and that relational database management systems could be used for OLAP. These vendors called their technology of storage Relational OLAP(ROLAP).

MOLAP implementations usually outperform ROLAP technology, but have problems with scalability. ROLAP is scalable and can leverage information from the relational database technology.

Hybrid OLAP is an effort to harness the best features of both ROLAP and MOLAP and provide the user with superior performance and scalability.

Microsoft SQL Server 2000 Analysis Services leads the market in giving the user flexible options to choose between the various storage modes. The OLAP Administrator can make his choice between MOLAP, ROLAP and HOLAP and the underlying data model will be entirely invisible to the client application and the end user will only perceive cubes. The integration of OLAP services with relational databases is superior in that it maintains strong links with the source data, the OLAP multidimensional metadata and the aggregations themselves by linking the graphical user interface design tools and wizards directly to OLE DB. While defining ROLAP data models, all relational database structures are defined, populated and maintained. The developer is not burdened with the need to define relational database structures or worry about managing complex queries across multiple tables and servers.

The goals of Analysis services storage engine is to improve ease of use so that the applications using database technology can be deployed widely and the database becomes completely transparent to the database administrator. The ease of use is fostered by the following features:

  1. Standard operations can be performed by end users themselves and the database administrator is free to perform his other jobs.  Branch offices, Mobile units and desktop users can now access the Analysis services in a variety of ways for analysis of data.
  2. Transparent server configuration, database consistency checker(DBCC), index statistics and database backups make for ease of use.
  3. The streamlined and simplified configuration options, automatically adapt to the specific needs of the environment.

Organizations that are expanding their business too, find Microsoft SQL Server 2000 Analysis services useful as it delivers a single database engine that scales from a laptop computer to terabyte size symmetric multiprocessing(SMP) clusters while maintaining the security and reliability demanded by mission critical business systems.  The features that make it scalable are:

1. New disk format and storage subsystem to provide storage that is scalable for small to large databases.

2. Redesigned utilities that support terabyte size databases efficiently

3. Large memory support to reduce the need for frequent disk access.

4. Dynamic row level locking to allow increased concurrency, especially for online transaction processing applications.

5.      Unicode support to allow for multinational applications.

Reliability is ensured by replacing complex data structures and algorithms with simple structures that scale better and do not have concurrency issues.  The Analysis services dispenses with the need to run the DBCC check prior to every backup and this results in significantly faster DBCC.

One factor that impacts on cube storage is sparsity.  Sparsity is defined as an instance of the longest common subsequence problem in which the number of matches is small compared to the product of the lengths of the input strings. The performance of the cube depends on the nonzero structure of the matrix as well as the characteristics of a given memory system. It tends to perform poorly on modern processors, because of its high ratio of memory operations to arithmetic operations and the irregular memory access patterns.  Missing or invalid data values create sparsity in the OLAP data model. In the worst case, an OLAP product would nonetheless save an empty value. For example, a company may not sell all products in all regions, so no values would appear at the intersection where products are not sold in a particular region. Analysis Services has got round this problem in innovatively by not allocating storage space to empty cells.  Both MOLAP and ROLAP implementations manage storage requirements extremely well, as a result, and create smaller

OLAP models of data as compared to the source. Data compression is employed and a sophisticated algorithm designs efficient summary aggregations to minimize storage without sacrificing speed.

While data sparsity is frequently highlighted by some OLAP vendors as a deciding factor in OLAP architectures, the differences between vendor implementations of sparsity management is minor compared to the more significant data explosion caused by pre-calculating too many aggregates.  Analysis services gets round this problem by determining which aggregations provide the greatest performance improvements and also allows the database administrator trade off between system speed and disk space required to manage aggregations through the storage design wizard.

To ensure that the OLAP models confirm to actual usage patterns, Analysis services optionally logs queries sent to the server and then fine tunes the set of aggregations based on these logs. The Usage based optimization Wizard allows the database Administrator to direct the Analysis services to create a new set of aggregations for all queries that take longer than ‘n’ seconds to answer.

It is critical to optimally design and store a number and variety of cubes for data analysis is large scale data warehouses. While designing these cubes Analysis Services prompts the users to make important decisions about the storage mode and the level of aggregation of cubes. Since cubes contain a large number of aggregations and data in multidimensional structures, they require substantial storage. Storage and aggregation options can be made using the Storage Design Wizard or the Usage Based Optimization Wizard or an explicit filter can be defined to restrict the source data that is read into the cube while using any of the storage modes available in Analysis services.

Relational OLAP stores fact data and aggregations in the relational database server. Multidimensional OLAP stores fact data and aggregations in the Analysis server in a multidimensional format. Hybrid OLAP stores fact data in the relational database server, and aggregations are stored on the Analysis server in an optimized multidimensional format.
MOLAP storage takes up more space than HOLAP or ROLAP as the MOLAP storage does not contain a copy of original fact data and dimensions. Aggregation calculations also increase the disk space required. Linked cubes use the aggregations of its source cube (which is stored on another Analysis Server) and has no data storage requirements of its own. Real-time cubes use the relational database for real-time OLAP. It requires no additional storage space as all aggregations are performed in real time. Virtual cubes also requires no storage space as they draw their fact data and aggregations from different source tables already existing in the Analysis server to present a view of the data to the user.

« « MSAS: Defining Cube Properties
MSAS: The Storage Design Wizard » »

Author Description

Avatar

Editorial Team at Exforsys is a team of IT Consulting and Training team led by Chandra Vennapoosa.

Free Training

RSSSubscribe 394 Followers
  • Popular
  • Recent
  • MSAS : Working with Standard Dimensions

    March 31, 2005 - 0 Comment
  • MSAS – Writebacks

    April 28, 2005 - 0 Comment
  • Microsoft Analysis Services Installation

    March 5, 2005 - 0 Comment
  • MSAS: Introduction and Working with Measures

    April 9, 2005 - 0 Comment
  • MSAS : The Data warehousing framework of SQL Server 2000 – Part 2

    March 18, 2005 - 0 Comment
  • MSAS – Introduction and Managing Partitions

    April 19, 2005 - 0 Comment
  • MSAS : Basics of Levels

    March 31, 2005 - 0 Comment
  • MSAS – Introducing Analysis Services Security

    May 2, 2005 - 0 Comment
  • MSAS : Introducing Analysis Manager Wizards

    March 7, 2005 - 0 Comment
  • MSAS: Defining Cube Properties

    April 9, 2005 - 0 Comment
  • MSAS – Browsing the Dependency Network

    May 6, 2005 - 0 Comment
  • MSAS – Building a Relational Decision Tree Model

    May 6, 2005 - 0 Comment
  • MSAS – Introduction to Data Mining

    May 6, 2005 - 0 Comment
  • MSAS – Applying security to a Dimension

    May 5, 2005 - 0 Comment
  • Tutorial 65: MSAS – Managing Cube Roles

    May 5, 2005 - 0 Comment
  • MSAS – Understanding Database Roles

    May 5, 2005 - 0 Comment
  • MSAS – Securing User Authentication

    May 2, 2005 - 0 Comment
  • MSAS – Introducing Analysis Services Security

    May 2, 2005 - 0 Comment
  • MSAS – Writebacks

    April 28, 2005 - 0 Comment
  • MSAS – Defining and Creating Drillthrough

    April 26, 2005 - 0 Comment

Exforsys e-Newsletter

ebook
 

Related Articles

  • MSAS – Browsing the Dependency Network
  • MSAS – Building a Relational Decision Tree Model
  • MSAS – Introduction to Data Mining
  • MSAS – Applying security to a Dimension
  • Tutorial 65: MSAS – Managing Cube Roles

Latest Articles

  • Project Management Techniques
  • Product Development Best Practices
  • Importance of Quality Data Management
  • How to Maximize Quality Assurance
  • Utilizing Effective Quality Assurance Strategies
  • Sitemap
  • Privacy Policy
  • DMCA
  • Trademark Information
  • Contact Us
© 2023. All Rights Reserved.IT Training and Consulting
This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.AcceptReject Read More
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT