Blog 5: Statistics Denial, Myth #1: Traditional Techniques Straw Man [Blog Series]

The current buzz about big data and data science is generating interest and a sense of urgency.  However, the promotional hype is accompanied by what we have elsewhere called “Statistics denial.”  This consists of a body of harmful misconceptions that conspires to leave those innocent of statistical understanding with the impression that there are these 'new' disciplines, which somehow transcend the old obsolete statistical analysis—traditional Statistics.  This impression is 'grounded' in straw man arguments that grossly mischaracterize applied statistics.

Traditional Techniques Straw Man

[pullquote cite="Ben Goldacre, Bad Science" type="right"]You cannot reason people out of a position that they did not reason themselves into.[/pullquote]

One of the quaint straw-man arguments is that “statistics is limited to 'traditional' or 'classical' methods, such as those from STAT 201."  Consistent with the principle of “the big lie,” this assertion confuses as much as it misinforms.  As innumerable enterprises, organizations, and the people that comprise them struggle to acclimate to an ever-renewing knowledge-based economy, the last thing we need is more confusion about how to extract useful information from avalanches of data.

 

The original use of the term 'traditional' was merely to differentiate older tools from newer ones.  Statistics deniers have exaggerated this into a fantasy they appear to want to believe, i.e., that statistics ended its evolution in the 1940s.  This is like mischaracterizing medical practice as only consisting of blood testing because that is what happened during their last physician visit.  Not surprisingly, armed with this astonishingly fictive viewpoint, they lack the statistics understanding and vocabulary to articulate exactly what comprises 'traditional statistics.'  Just ask them.

 

Here, for example, is a quote that conveys the feeling, “... you CANNOT bring the ‘baggage’ of traditional statistics into the analysis, or everything can get 'messed up.'”  Really?!  This mischaracterization spawns from a rote, mechanical tool-based peek at statistics, rather than a holistic problem-based understanding.  Mastering applied statistics requires field experience, as developed by generations of applied statisticians/quants.  Also, no one should have the expectation that reading a text book, following recipes, or searching the internet will generate practice experience.  There is simply no shortcut.

Reality

There are these statistics problems as we clarified in the May/June 2015 issue of Analytics Magazine, 'Preparing For The Coming Flood Of Statistical Malfeasance,'.  They all involve uncertainty with the numbers and this requires statistical inference.

Applied statistics embodies our approach to and way of thinking about numerical uncertainty.  This is the traditional part.  It borrows freely from everywhere, not limiting itself to some static set of algorithms taught in STAT 201.  The 'traditional techniques straw man' is also like mischaracterizing mathematics to be all ONLY about addition, with no regard or acknowledgement for subtraction, multiplication, division or the multitude of other operations therein.  This denies the completeness, synergy, and ongoing development of statistics, encouraging disconnected balderdash.

[pullquote cite="Dr. Rodney Mckay, Stargate Universe" type="right"]It's all in the algorithm[/pullquote]

Blog5_Statistics Denial, Myth #1- Traditional Techniques Straw Man

This play on words is deceptively hazardous.  It means that, despite their feigned qualifications, promoters lack a fundamental understanding of what they are talking about.  At the same time, they are not lacking in overconfidence or motivation to place their interests ahead of those of their clients.  Misunderstandings are innocent.  Deliberate mischaracterization of topics outside of your expertise and for personal gain is the stuff of hucksterism!  It is all about sales.

When they replace applied statistics with their own half-baked unvetted corruption, they inevitably omit everything they do not understand.  If their understanding of statistics is limited to a STAT 201, this would amount to a great deal.

Close

In addition to unwanted confusion, this promotional hype is leading to another round of adulterating statistics and circumventing best practice.  In 'Blog 2: Statistics Denial, Statistical Debacles ...,' we discussed the harm.  Once the safeties are removed, we are more exposed to statistics debacles like those at AIG, Fannie Mae, Moody's, Fitch Ratings, S&P Ratings, Google Flu Trends, et al.

Applied statistics is not limited to some set of traditional tools or some promoter's portrayal of it.  There are no new techniques for data analysis that displace our ever evolving statistics.

We sure could use Deming, right now.  Many of us, who consume or produce data analysis, hang out in the new LinkedIn group: About Data Analysis.  Come see us.

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Randy Bartlett

Randy Bartlett

Statistician/Statistical Data Scientist at Blue Sigma Analytics

Randy Bartlett, Ph.D. CAP® PSTAT® is a statistician/statistical data scientist with 20+ years of practice experience analyzing and reviewing data analysis; and leading business analytics teams. He designed 'A Practitioner’s Guide to Business Analytics' to be the foremost reference on how corporations can better implement business analytics and in this era of Big Data.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

How to Start Incorporating Machine Learning in Enterprises

25 Jun, 2017

The world is long past the Industrial Revolution, and now we are experiencing an era of Digital Revolution. Machine Learning, …

Read more

Fighting diseases with Pandemic simulation modelling

18 Dec, 2016

The goal of this project was to produce a high-resolution agent based model (ABM) suitable for the assessment of life …

Read more

What I Always Wanted To Know About Big Data* (*but was afraid to ask)

14 Jan, 2017

  When I first heard the term Big Data few years ago, I didn’t think much of it. Soon after, …

Read more

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.