When machine learning and streaming data meet
- by 7wData
I recently started using a task automation app on my smartphone to automate many of the settings I had been changing manually. Most of these settings revolved around my current location. When at home, I connect to my wireless network to avoid monthly data overages on my smart phone plan. I also connect to my Bluetooth earpiece for hands-free talking, turning the volume up for calls and notifications. When I leave the house, I disconnect and disable both Wi-Fi and Bluetooth for security purposes. I also switch all volume settings to silent with vibrate.
The automation app uses GPS sensor data to periodically check where I am, and it adjusts these settings as my location changes. As useful as this automation is, it still relies on user input. And this means I have to configure the automation algorithm myself, teaching it to understand and implement my preferences.
This pales in comparison to the potential of machine Learning, where computer algorithms learn without explicitly being programmed (beyond perhaps a training model with basic rules to frame the learning process). Such algorithms learn autonomously as they’re iteratively exposed to more data.
Machine Learning itself is not a new concept. Machines learned to play (and consistently beat human champions at) checkers in the 1950s, chess in the 1990s, Jeopardy! earlier this decade, and the complex ancient Chinese game Go last year. Recent history has also super-powered Machine Learning with rapid advancements in compute power, data storage, parallel processing, network bandwidth and high-speed connectivity. And over the years, machines have also learned to do a lot more than just play games with humans. In fact, machine learning has progressed to the point where it’s challenging the role humans play.
In traditional analysis, a human selects a model they believe best fits a collection of data. I believe humans will remain an essential element of analytics – and while a human analyst might create one or two good models a week, machine learning is capable of creating thousands of good models per week. This is why machine learning is one of the leading drivers of the evolution of analytics – especially when it’s paired with streaming data, which shortens learning cycles and increases the number of iterations that can be rapidly processed.
[Social9_Share class=”s9-widget-wrapper”]
Upcoming Events
Evolving Your Data Architecture for Trustworthy Generative AI
18 April 2024
5 PM CET – 6 PM CET
Read MoreShift Difficult Problems Left with Graph Analysis on Streaming Data
29 April 2024
12 PM ET – 1 PM ET
Read More