Democratize big data: How to bring order and accessibility to the data lake

Democratize big data: How to bring order and accessibility to the data lake

Democratize big data: How to bring order and accessibility to the data lake

The good news is that 10-year-old Hadoop is maturing quickly. The bad news is that many companies are still struggling to get beyond pilot projects and support many applications on this new data-management platform. That's why I wrote my latest report, "Democratize Big Data: How to Bring Order and Accessibility to Data Lakes."

First, let's consider the industry leaders that are doing great things with data lakes, drawing on examples from the recent Hadoop Summit:

In financial services CapitalOne has been making waves this year, appearing at multiple events to talk about its Hadoop and Spark-based fraud-detection and its big data analytics, streaming, and security work.

In retail Macy's embraced Hadoop more than five years ago to power insights for Macys.com. Today it's doing more sophisticated cross-channel analysis, driving personalized promotions encouraging online customers to shop in stores and in-store customers to obtain out-of-stock and online-only items at Macys.com.

In manufacturing Ford relies on Hadoop for connected car capabilities. Ford does filtering and decision-making at the sensor and car level while uploading crucial data points for centralized insight and analysis. For example, FordPass app users can remotely check their car's fuel level, location, and diagnostic error codes, but detailed data used by service technicians remains in the car's black box.

Read Also:
Stitch Fix Uses Algorithms, Machine Learning To Dress Its Customers

In insurance Progressive has been a pioneer of usage-based pricing with Progressive SnapShot. The company has more than 15 billion miles' worth of driving data in a Hadoop-based data lake, but it can drill down and offer discounts to individual policy holders based on factors such as their total miles driven, nighttime driving, and speed and braking habits.

These examples are inspiring, but behind every breakthrough there's been a lot of hard work.

 



Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
How big data is revolutionizing the health care industry

Chief Analytics Officer Spring 2017

2
May
2017
Chief Analytics Officer Spring 2017

15% off with code MP15

Read Also:
How data science is changing the face of human rights

Big Data and Analytics for Healthcare Philadelphia

17
May
2017
Big Data and Analytics for Healthcare Philadelphia

$200 off with code DATA200

Read Also:
When it’s Time for Cloud Migration

SMX London

23
May
2017
SMX London

10% off with code 7WDATASMX

Read Also:
Get the data your business needs without paying high fees
Read Also:
Stitch Fix Uses Algorithms, Machine Learning To Dress Its Customers

Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
We’ve given artificial intelligence too much power far too quickly

Leave a Reply

Your email address will not be published. Required fields are marked *