Big Data, Open Data and the Need for Data Transparency (Industry Perspective)

Big Data

Data is part of everything we do, especially given the current open data movement. From financial market performance to farmer’s market locations, weather to health care, bridge and road safety to population information, significant amounts of data are yielded and available for aggregation and analysis, and can be applied to improve public services. This is the philosophy behind the open data movement —that if we make all of this data available to the public, at least the high-value data, we can crowdsource public service issues and come up with the best possible solutions. 

But open data is only as good as the data analytics platforms and true data transparency policies on which it relies. Bringing big data, open data and data transparency together empowers data to solve some of the world’s most challenging problems. Over the last few years alone, I have seen big data used to reduce sepsis, understand Parkinson’s disease, combat child sex trafficking and fight Ebola, among many other noble causes

One such cause was the University of Texas at Austin (UT) and the Texas Advanced Computing Center collaborating on two Data for Good hackathons to develop solutions to prevent, detect, fight and reduce mosquito-transmitted diseases, including the Zika virus. More than 120 data scientists, engineers and UT Austin students brought together their diverse set of skills to apply data to a number of questions related to the virus. 

In the first hackathon, solutions involved scraping outbreak data from the Centers for Disease Control and Prevention (CDC), the World Health Organization (WHO) and other similar organizations around the world. These “hackers” paired the data with news reports and social media feeds to create visualizations of the quick progression of Zika cases across Central America in an effort to learn more about the Aedes mosquito and the spread of the virus. One participant presented a method to detect stagnant bodies of water and differentiate between green or brown bodies of water from a clear pool or a stream in hopes of identifying prime mosquito breeding grounds. Others worked on a data collection mobile app that allows people to quickly and easily report potential Zika cases and symptoms on their mobile device. 

At the second hackathon, projects focused on research in the clinical and epidemiological areas of Zika. Projects ranged from identifying Zika in water samples using metagenomic data to exploring the Zika protein and docking to identify potential drugs to fight infections. The identification of Zika in publicly available water sample data was a huge discovery — and proof that these projects have the potential of making a significant scientific impact. These projects are hopefully the seed to future discoveries or insights.

 

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

Platforms for Making Deep Learning Easier for GIS

29 Aug, 2019

While so-called ‘deep learning’ methods, that is machine learning techniques that use layered, artificial neural networks, to perform learning of …

Read more

From Chaos to Clarity: Data Lakes for Efficient Data Management

11 Feb, 2024

Unlock efficient data management with data lakes! Dive into benefits, architecture, and best practices for transforming chaos into clarity.

Read more

Why data scientists are vital for increasing customer loyalty

11 Apr, 2017

The importance of big data is increasing across all industries — as are the jobs required to tap into the …

Read more

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.