e9f1bb85e86d4840ad52efcadfec7a2d

The care and feeding of a data project

The care and feeding of a data project

Gartner recently reported[i] that nearly 50% of data projects fail on a regular basis. For every successful big data analytics implementation, there are hundreds of projects that start with a bang and end with an empty Hadoop cluster. How can an organization ensure that it is not spending time and money on a project that doesn’t return results?

Successful data projects can often be thought of the same process as panning for gold. The flow of data between and through various departments in a company can be thought of as analogous to water, with important metrics for decision-making as the nuggets of gold that can help consumers make better choices[ii], drive better decision-making[iii] across departments, and even save lives[iv].

As with a real-life mining operation involving large teams and cross-functional communication, the process of "mining" the flow of data can become complicated for a number of reasons. In real gold mining operations, it could be that the pipe through which the water flows was built to incorrect spec, or maybe no one is keeping track of where the water is flowing, and maybe the miners at the end of the line don’t quite know which type of nuggets to keep and which to throw back into the current.

Read Also:
Top 9 ethical issues in artificial intelligence

Similarly, there are numerous reasons data projects can fail, from picking the wrong technology, to time constraints, to conflicting management philosophies.

Every project needs someone who is championing the success of the product because they understand its importance to the company, and who can influence management input into the process. Often, executives will perceive the need for better insight and leave it to other teams to plan implementation, moving on to more urgent, tactical business needs. But a big data project involves a potentially large pool of resources to cooperate and shed light on the data: engineers, data scientists, system administrators, data governance and security teams. All of these individuals need to be driven by a single overarching goal, often coming from a sponsor who is close to core company goals and can help offer input to drive the project in the right direction.;



Data Innovation Summit 2017

30
Mar
2017
Data Innovation Summit 2017

30% off with code 7wData

Read Also:
How to Prepare for a Product Information Management (PIM) Initiative
Read Also:
Analyze your Azure Security Center data with Power BI

Big Data Innovation Summit London

30
Mar
2017
Big Data Innovation Summit London

$200 off with code DATA200

Read Also:
Have We Allowed Big Data To Become Too Powerful?

Enterprise Data World 2017

2
Apr
2017
Enterprise Data World 2017

$200 off with code 7WDATA

Read Also:
Semantic Graph Databases: A worthy successor to relational databases

Data Visualisation Summit San Francisco

19
Apr
2017
Data Visualisation Summit San Francisco

$200 off with code DATA200

Read Also:
Next Generation Analytics: The Collision of Classic & Big Data Analytics

Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
Managing information policy compliance to prevent fraud

Leave a Reply

Your email address will not be published. Required fields are marked *