Big Data and the Philosophy of Knowledge

We live in an era in which "big data" is supposed to solve lots of problems for businesses.  By looking at the buying patterns of a large number of individuals, retailers can get insights into how to sell to customers more effectively.  Credit card companies can detect fraud by exploring purchase patterns that have signaled bad transactions in the past.  Companies can learn about the types of employees who are likely to be effective by exploring characteristics that have been good indicators of success in those roles before.  Websites like  http://www.fivethirtyeight.comfivethirtyeight.com use data from a variety of sources like polls to help make predictions about events like polls.

This approach signals a shift in which companies are taking an empirical approach to answering questions.  The idea is that data from the past can be used to determine what might be true in the future.

I am a fan of big data and (as a scientist) I am also happy to see people interested in answering questions by looking at sources of data in the world.

At the same time, I think it is important for people to be clear about the kinds of questions that data can and cannot answer.  That means that it is valuable to take a peek at the philosophical field of epistemology, which studies knowledge.

A key question in epistemology is how we can know whether something is true and whether a particular opinion is worth believing.  Data is often a good source of belief, but it is not useful for answering every question.

Data is most valuable for helping to settle matters of fact.  Science advances by using data to distinguish between theories that explain how aspects of the world works.  Different theories make different predictions about what we are likely to observe in a particular situation.  When the data support one theory over another, that increases our confidence that a particular theory is correct.  Of course, no theory can ever be proven definitively.  New data may always come along that contradict a strongly-held theory. But, many theories (like the theory of evolution in biology) have enough support that it would be hard to supplant them.

There are many things that businesses need to know that are matters of fact of this type.  Drug companies, for example, can use the scientific method to explore whether a particular drug is effective at treating a disease.

 

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

How artificial intelligence and big data can help preserve wildlife

15 Feb, 2022

The field of animal ecology has entered the era of big data and the Internet of Things. Unprecedented amounts of …

Read more

Building an Agile and Scalable Data Environment for a Global Mining Leader

5 Dec, 2019

Mining companies understand the importance of efficiencies scale. A common operational objective among the industry is to streamline as many …

Read more

Building a Data Platform: 7 Signs It’s Time to Invest in Data Quality

14 May, 2022

One of the most frequent questions I get from customers is: when does it make sense to invest in data …

Read more

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.