big-data-in-brazil-the-year-ahead

Data lakes, don’t confuse them with data warehouses, warns Gartner

Data lakes, don’t confuse them with data warehouses, warns Gartner

In mid-2014, a pair of Gartner analysts levied some trenchant criticisms at the increasingly hyped concept of data lakes.

"The fundamental issue with the data lake is that it makes certain assumptions about the users of information," said Gartner research director Nick Heudecker.

"It assumes that users recognize or understand the contextual bias of how data is captured, that they know how to merge and reconcile different data sources without 'a priori knowledge' and that they understand the incomplete nature of datasets, regardless of structure." A year and a half later, Gartner's concerns do not appear to have eased. While there are successful projects, there are also failures -- and the key success factor appears to be a strong understanding of the different roles of a data lake and a data warehouse.

Heudecker said a data lake, often marketed as a means of tackling big data challenges, is a great place to figure out new questions to ask of your data, "provided you have the skills".

Read Also:
7 things that are getting smarter in IoT era

"If that's what you want to do, I'm less concerned about a data lake implementation. However, a higher risk scenario is if your intent is to reimplement your data warehousing service level agreements (SLAs) on the data lake."

Heudecker said a data lake is typically optimised for different uses cases, levels of concurrency and multi-tenancy.

"In other words, don't use a data lake for data warehousing in anger."

It's perfectly reasonable to need both, he said, because each is optimised for different SLAs, users and skills.;

 



Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
Challenges in Data Science: How to Better Organize Enterprise Components

Chief Analytics Officer Spring 2017

2
May
2017
Chief Analytics Officer Spring 2017

15% off with code MP15

Read Also:
25 Data Management Vendors Worth Watching

Big Data and Analytics for Healthcare Philadelphia

17
May
2017
Big Data and Analytics for Healthcare Philadelphia

$200 off with code DATA200

Read Also:
Understanding the keys to enterprise information management
Read Also:
Are you still struggling with your data?

SMX London

23
May
2017
SMX London

10% off with code 7WDATASMX

Read Also:
Things you need to know about Big Data

Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
The misanthrope’s vain struggle with big data

Leave a Reply

Your email address will not be published. Required fields are marked *