Solving the data quality conundrum: how to go from big data to trustworthy data

Solving the data quality conundrum: how to go from big data to trustworthy data

Businesses often struggle with hard to access data and cumbersome processes, so how can they find quick and simple ways to locate, prepare and verify the data they need?

Lets consider the classic meeting scenario where a Sales Director presents the company’s most profitable customers to the management team.

Before she has got even halfway through her first slide, someone interjects to point out that Cable&Wireless Worldwide is no longer trading and General Electric reduced its regular order significantly last quarter.

People around the table have spotted errors in the data and trust in the analysis is immediately lost - faces around the table tell the story all too clearly. How can that team go on to make an effective decision?

> See also:The key steps to achieving data quality over quantity

Similarly if you’re a data analyst you’ve probably experienced the often tense relationship that can develop with IT colleagues that are integrating and preparing data on your behalf.

Comments such as 'I thought we asked for all three customer databases to be brought together for this analysis' or 'sorry for us to extract, transform and load that much data in different formats it’s going to be another three months' are not unusual.

These scenarios highlight two of the most pressing problems preventing companies from making effective, data-driven decisions. Business leaders are witnessing the impact of poor quality data; data analysts and IT managers are struggling with the challenge of pulling disparate data together from multiple sources.

In a world where companies must make increasingly rapid decisions, both of the above can: frustrate, hamper and sabotage even the best-laid plans.

Making sense of a company’s data typically requires individuals in different roles with different skill sets. The business executives that know what questions to ask of the data, data analysts that hunt through data in order to answer those questions and finally there are IT people that ensure data is prepared and ready for analysts to work with.

While everyone has a role when it comes to preparing data, the challenge comes when empowering all groups with the processes and tools they need to collaboratively manage data.

'Big Data' has of course made the opportunities (or the problems) even bigger, with the promise of unprecedented insights into markets, customers and operations.

 

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

Big Data vs. Little Data

30 Aug, 2016

All the attention, hype and money is pouring into Big Data. It’s the way to get big budgets, lots of …

Read more

Moving from data swamp to smart data

4 Jul, 2018

Over the last decade, the increased use of unstructured and alternative data, and the ascendance of the cloud, has posed …

Read more

How the future of data privacy regulation is spurring change

2 Nov, 2019

CISO Robb Reck is working against the clock. As security leader at Ping Identity, a Denver-headquartered software company, Reck oversees …

Read more

Recent Jobs

Cyber Security Engineer – P2

Hybrid (Aurora, CO, USA)

5 Mar, 2024

Read More

Sr. Manager – Data and Analytics Technical Lead

Hybrid (Dedham, MA, USA)

5 Mar, 2024

Read More

Manager, Business Data and Analytics

Hybrid (Troy, OH, USA)

5 Mar, 2024

Read More

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.