The Seven Deadly Sins Of Enterprise Data Quality
- by 7wData
Atchison Frazer looks at the issues that can lead to problems with data quality
Enterprise data quality problems can be categorised into three main areas:
All these complex processes are an important part of data processing and therefore cannot be cut off in an effort to avoid problems. The only way to maintain the integrity of data is to make certain that all these processes work as intended and avoiding the seven major causes of data quality problems.
Most of the time, databases begin with the conversion of data from a pre-existing source. Data conversion never goes as seamlessly as intended. Some parts of the original datasets fail to convert to the new database, while other datasets just mutate during the process. The source itself could also not be all that perfect to begin with. To avoid problems, more time must be spent on profiling the data, as compared to time spent on code transformation algorithms.
When combining old systems with new ones or phasing out systems, data consolidation is crucial.  Problems may arise, especially when unplanned – resulting in hastened system consolidations.
Batch feeds are large data exchanges that happen between systems on a regular basis. Each batch feed carries large volumes of data and if bottlenecks occur, this can cause problems for consequent feeds. This can be avoided by using a tool to detect process errors and stop them from causing performance problems.
Real-time interfaces are used to exchange data between systems.;
Â
[Social9_Share class=”s9-widget-wrapper”]
Upcoming Events
Strategies for simplifying complex Salesforce data migrations – Free Webinar
27 March 2024
5 PM CET – 6 PM CET
Read MoreTags
You Might Be Interested In
Machine Learning And Privacy: A Problem?
19 Sep, 2016Since the dawn of big data, privacy concerns have overshadowed every advancement and every new algorithm. This is the same …
Data Science vs. BI vs Statistics: What’s the Difference?
25 Dec, 2016The use of statistics in business can be traced back hundreds of years.  As early as 744 AD, statistics were …
Under pressure: 4 main stressors for big data leaders
22 Jan, 2017CEOs and corporate boards want to see big data deliver results in company revenues, operations, and financial performance. The C-suite’s …
Recent Jobs
Do You Want to Share Your Story?
Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.