Is this the age of Big OLAP?

Is this the age of Big OLAP?

There was a time when analytics was synonymous with BI, and BI was synonymous with OLAP -- Online Analytical Processing. The term was meant to contrast with the more common Online Transaction Processing (OLTP), and involved the creation of multi-dimensional "cubes" rather than 2-dimensional tables. Each dimension is a different category with which to perform drill-down analyses on numerical data, known as measures.

Now that you've had your BI 101 crash course, look around at numerous analytics products like Tableau, and you'll see the paradigm of dimensions and measures is alive and well. OLAP never died, even if its underlying technologies morphed a bit.

The justice of scale What has dogged OLAP, though, is its scalability. Most OLAP servers run on single, albeit beefy, servers, which limits the parallelism that can be achieved and therefore imposes de facto limits on data volumes. Customers who hit these scalability ceilings may contemplate using Big Data technologies, like Hadoop and Spark, but those tend not to employ the dimensional paradigm to which OLAP users are accustomed.

What to do? Well, a few vendors have decided to take Hadoop and Spark, and leverage them as platforms on which big OLAP cubes can be run and built. The vendors, namely AtScale, Kyvos Insights and Arcadia Data, have looked at Big Data adoption patterns in some enterprises, and seen that momentum has stalled. Their approach has been to let people in those enterprises work in the OLAP environments they are comfortable with and, at the same time, make use of their Hadoop clusters.

AtScale's CEO, David Mariani, was the person behind a couple of the biggest Microsoft OLAP projects (at Yahoo and Klout). And while he was able to do big things with Microsoft's OLAP platform, SQL Server Analysis Services (SSAS), he definitely hit up against scalability limits, including cube re-processing times of as much as a week. His motivation for creating a more resilient OLAP platform was pretty clear, so he formed AtScale.

Three approaches AtScale cubes can be made to appear to BI clients as if they were SSAS cubes. So compatibility is high.

 

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

The Best Data Scientists Are Failures

11 Feb, 2017

There are some inbuilt human traits that are huge faults. Think about anxiety, it does considerably more harm than good, …

Read more

Despite Massive Investments In AI And Digital Transformation, Survey Finds Poor Results

18 Mar, 2019

The term “digital transformation” has come to mean steps that move an organization towards adopting data-driven business models, typically involving …

Read more

How Alternative DBs are Disrupting the Conventionals in 2018

10 Sep, 2018

After providing a viable alternative for enterprise IT systems for nearly two decades, are NoSQL databases finally making significant inroads …

Read more

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.