Data Curation, Analytics Collaboration Top Big Data Concerns
- by 7wData
IT and data professionals are under increased pressure to deliver the goods when it comes to data – that is, insights that can help drive business decisions and boost profits. Toward that goal, many organizations are focusing on collaborative analytics to empower analysts and business users to get their jobs done with greater accuracy and speed.
Stephanie McReynolds, vice president at Alation, spoke with Information Management about what these trends mean, and her observations on the top data analytics and data management themes to emerge from the recent Strata & Hadoop World event in San Jose.
Information Management: What are the most common themes that you are heard at the conference?
Stephanie McReynolds: Re-defining data governance in the context of Hadoop and big data use cases was a key theme of Strata San Jose.
Sessions highlighted how the maturation of Hadoop implementations in the market requires some tooling to support governed self-service. Sessions included our customer eBay, who spoke about tooling for 1,000s of analysts to more effectively find, understand and trust their data stored in Hadoop and Teradata.
Trifacta, Navigator and Waterline presented a demonstration of how a realistic data governance workflow could look like in Hadoop. And Joe Hellerstein shared an open source metadata management project called Ground. Discussions around data stewardship, governed self-service analytics, and metadata were very topical for the community of attendees.
IM: What are the most common challenges that attendees were facing with regard to data management and data analytics?
SM: One, that machine learning delivers the true business value of big data. Machine learning has emerged as the most likely way that every organization will derive value from data stored in HDFS. No matter which processing engine is used to prepare the data and execute queries, machine learning algorithms are where big data value is derived. Two, that broad-based analyst interaction with big data is important. Big data analysis should be a collaborative endeavor. Detailed knowledge about what the data means, how it was derived and the appropriate business uses sit in the heads of lots of different individuals in the organization.
[Social9_Share class=”s9-widget-wrapper”]
Upcoming Events
Strategies for simplifying complex Salesforce data migrations – Free Webinar
27 March 2024
5 PM CET – 6 PM CET
Read MoreCategories
Tags
You Might Be Interested In
Will the Real “Modern Data Stack” Please Stand Up?
14 Nov, 2021Over the past few years the “modern data stack” has entered the vernacular of the data world, describing a standardized, …
How the Big Data Explosion Has Changed Decision Making
3 Sep, 2016Organizations I work with increasingly struggle to straddle two painfully polarizing operating principles. On the one hand, they desperately seek …
New AI Regulations Are Coming. Is Your Organization Ready?
5 May, 2021In recent weeks, government bodies — including U.S. financial regulators, the U.S. Federal Trade Commission, and the European Commission — …
Recent Jobs
Do You Want to Share Your Story?
Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.