algorithms-we-do-trust

In Algorithms We Trust. Do We?

In Algorithms We Trust. Do We?

Let's try to paint a likely not-too-distant future. In this future, everything around us will be managed by algorithms. They manage and recommend what we want to watch; they control traffic of our driver-less cars; they control those drones which deliver our pizza; predict for you which one of your friends will become your future spouse, etc. They will make our life effortless and predict what things will happen next or what's best for us. We all wish that it is that simple.

As we are picking up massive data every second, algorithms are critical to how we make sense of them and our reliance on algorithms is growing by the second. But how much faith should we put into those algorithms, and how reliable they are depends on who you talk to. The accuracy of the algorithmic differentiation (automatic differentiation) is key in dealing with data volatility in many complex cases where accuracy of data is critical to the final outcome. I don’t know when we can have statistical evidence comparing how often driverless cars mistakes and how often human drivers make mistakes or how well a software program investing in stocks makes mistakes and human making investment mistakes.

Read Also:
Big Data Could Lower Insurance Rates for Optimistic Tweeters

We need to develop programs to check whether algorithms are working as they were intended and monitoring algorithms by the results they produce based on machine performance metrics. Vetting algorithms in advance isn't practical at all as many are too complex for their outcome to be predicted. Algorithmic differentiation is used to fine tune algorithms that are complex to optimize. We will be placing our faith into the accuracy of these algorithms and trusting that they will deliver. I think we may be over-optimistic and mining a lot of data using statistical analysis still has a very strong random component to it. To optimize these models we need algorithmic differentiation and sometimes it feels like a scientific random number generator. The more data we have, the more simulation is needed and the more reliance on the significance of data, and significance means sensitivities. We’re in the midst of a transformation when industries are exploring how to use big data to create new business models.

Read Also:
The big data explosion sets us profound challenges


Data Innovation Summit 2017

30
Mar
2017
Data Innovation Summit 2017

30% off with code 7wData

Read Also:
The Top 5 Data Lake Capabilities Required to Deliver Business Value

Big Data Innovation Summit London

30
Mar
2017
Big Data Innovation Summit London

$200 off with code DATA200

Read Also:
Who Does What in Data Science [Infographic]

Enterprise Data World 2017

2
Apr
2017
Enterprise Data World 2017

$200 off with code 7WDATA

Read Also:
Predictive data, the real workhorse behind the Internet of Things

Data Visualisation Summit San Francisco

19
Apr
2017
Data Visualisation Summit San Francisco

$200 off with code DATA200

Read Also:
IBM Wants to Push Spark, Real-Time Big Data Tool, Into Mainstream

Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
Getting Emotional With Business Analytics

Leave a Reply

Your email address will not be published. Required fields are marked *