Advances in deep learning and other machine learning algorithms are currently causing a tectonic shift in the technology landscape. Technology behemoths like Google, Microsoft, Amazon, Facebook and Salesforce are engaged in an artificial intelligence (AI) arms race, gobbling up machine learning talent and startups at an alarming pace. They are building AI technology war chests in an effort to develop an insurmountable competitive advantage.
Today, you can watch a 30-minute deep learning tutorial online, spin up a 10-node cluster over the weekend to experiment, and shut it down on Monday when you’re done – all for the cost of a few hundred bucks. Betting big on an AI future, cloud providers are investing resources to simplify and promote machine learning to win new cloud customers. This has led to an unprecedented level of accessibility that is breeding grassroots innovation in AI. A comparable technology democratization occurred with the internet in the 1990s and, if AI innovation follows a similar trajectory, the world will be a very interesting place in five years.
First, advances in computing technology (GPU chips and cloud computing, in particular) are enabling engineers to solve problems in ways that weren’t possible before. For example, chipmaker NVIDIA has been ramping up production of GPU processors designed specifically to accelerate machine learning, and cloud providers like Microsoft and Google have been using them in their machine learning services.
These advances have a broader impact than just the development of faster, cheaper processors, however. The low cost of computation and the ease of accessing cloud-managed clusters have democratized AI in a way we’ve never seen before. In the past, building a computer cluster to train a deep neural network would have required access to capital or a university research facility. You would have also needed someone with a PhD in mathematics to understand the academic research papers on subjects like convolutional neural networks.
Although everybody points to improvements in CPU/GPU as the primary driver of AI innovation, this is only half the equation. Advances in AI algorithms in the mid-1980s broke the spell of the AI winter of the 1970s. The work of deep learning pioneers like Geoffrey Hinton and Yann LeCun solved some of the critical shortcomings that plagued earlier algorithms. In many ways, algorithms like Hinton’s backpropagation opened the floodgates for future algorithmic innovations, albeit these improvements happened at a slower, academic pace. DeepMind’s AlphaGo program, for example, combined deep learning with reinforcement learning to enable a computer that beat the world’s highest-ranked Go player in 2017 – a full 20 years later.
