Research Study Report Response Result Action Concept

Data Increasingly Used As a Force for Good

Data Increasingly Used As a Force for Good

Several top themes emerged from the recent Strata & Hadoop World conference in San Jose, including that of the use of data to improve life itself, from healthcare, to housing, to a dozen social issues in between.

Prakash Nanduri, CEO at Paxata, shared his observations and delight with this theme with Information Management. He also spoke about the full maturity of Hadoop in the market, and the wide-scale use of business intelligence and analytics among organizations today.

Information Management: What are the most common themes that you heard among conference attendees and how do those themes align with what you expected?

Prakash Nanduri: One of the most surprising themes I saw throughout the conference was “Data for good.” Very interesting work is being done to predict Ebola outbreaks, ongoing research about diabetes, mapping of low-income housing to those in need.

It’s always expected that you will attend sessions about banks using data to reduce risk or retail companies using data to find more customers, but it was very encouraging to see so much work being done by data scientists to improve lives.

Read Also:
Big data is eating the world – but it’s not eating the data scientist

IM: What are the most common data challenges that attendees are facing?

PN: The market for data analytics continues to grow – there is a BI application or tool for every use case. The only challenge there might be in understanding how these tools differ and whether or not the business needs them all.

On the data management side, it feels like those who have made the move to Hadoop for a modern data collection and storage architecture want to now make all the rich data they have available to their business teams. Their usual approaches for doing that are not keeping up – first, having to take data out of Hadoop and put it into traditional data warehouses defeats the purpose and even if that was economically feasible, the speed and volumes of data just break every traditional process.

People are looking for ways to understand the data without having to build schemas, and they want to shape it, clean it and work with it without creating month-long IT projects. Without a doubt, user-driven data preparation, big data discovery and real-time big data analytics were all hot topics, which signals to me that everyone is trying to figure out how to make better use of their data.

Read Also:
Can Big Data operations be manageable? Two companies say yes.

The other interesting thing I noticed is that everyone is struggling with data preparation and big data discovery. I think the perception is that the problems are faced by just business people and that data scientists have magic tools to make this easy, but clearly, they would rather not be doing this work if they could instead be doing high value analysis.

IM: What are the most surprising things that you heard from attendees regarding their data management initiatives?

PN: Hadoop has grown up. I heard fewer discussions about Hadoop as a science project being run by a small team, and more dialog about operational systems that are getting hooked to business initiatives. For example, a forward thinking team who is doing a ton of security analytics off all sensor data being collected in Hadoop. They are establishing baselines they could never do before because they now have two years’ worth of data to help them establish patterns, anomalies and outliers.

Read Also:
How Big Data Helps Today’s Airlines Operate

The other interesting thing I noted was the maturity of the ecosystem as a whole.

 



Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
How to make digital transformation a reality

AI Paris

6
Jun
2017
AI Paris

20% off with code AIP17-7WDATA-20

Read Also:
Cloud can drive innovation but only if you have the right Data Fabric

Chief Data Officer Summit San Francisco

7
Jun
2017
Chief Data Officer Summit San Francisco

$200 off with code DATA200

Read Also:
8 ways to make the most out of your customer data

Customer Analytics Innovation Summit Chicago

7
Jun
2017
Customer Analytics Innovation Summit Chicago

$200 off with code DATA200

Read Also:
Why CEOs must lead big data initiatives

HR & Workforce Analytics Innovation Summit 2017 London

12
Jun
2017
HR & Workforce Analytics Innovation Summit 2017 London

$200 off with code DATA200

Read Also:
Build the Right Team for Big Data Success

Leave a Reply

Your email address will not be published. Required fields are marked *