JVM developers moving to containers and microservices to keep up with fast data

JVM developers moving to containers and microservices to keep up with fast data

JVM developers moving to containers and microservices to keep up with fast data

Developers have never had it so good, swimming as they do in a sea of cheap, flexible cloud hardware and open source software. However, as a new Lightbend survey of 2,100 JVM developers suggests, there has never been a more precarious time for Java Virtual Machine (JVM) developers, as the traditional Java EE app server may be gasping its last breath. Perhaps this isn't surprising, given the fact that machine learning and microservices are completely changing how we program.

Yet, it's disconcerting for the thousands of engineers who have built their careers on what appears to be a dying art. As the survey report concludes, "The old world where JVM language developers relied on operators to do the work around deploying applications is in the midst of major upheaval, as the entire Java EE stack built around heavyweight app servers is losing relevance."

So long, and thanks for all the fish?

I spoke to Lightbend CEO Mark Brewer to get more background on the survey results and learn more about how JVM developers are grappling with modern data realities. He said the challenge stems less from the volume of so-called "big data" and more from meeting new requirements in speed and performance, which he calls the new era of "Fast Data."

Read Also:
Data integrity, the next big threat

This fast data world threatens to completely upend the traditional Java app server, as well as the ops teams and developers who love them.

Though a new slant on big data isn't really necessary—Gartner's "three Vs" of big data already incorporates velocity (in addition to volume and variety of data)—Brewer can be excused for fixating on speed. After all, as he stressed, this is the first time that "any application can take advantage of data not even written to disk—as it's still moving from its source to the application or database."

This means that you don't have to wait to do queries, and can actually process the data while it's still moving. It also means that speed increasingly defines applications.

Machine learning, anomaly detection, analytics—all of these big data use cases put a premium on speed. Nor are they alone. New applications like IoT, mesh devices, home automation, self-driving cars and telemetry data, and many other use cases are reliant on processing data while it's still "in motion," Brewer said.

Read Also:
HP Discover a new experience every time including Las Vegas 2014

None of which makes JVM developers' lives any easier.

From a JVM developer standpoint, Brewer told me, this trend has made the applications richer, but also forced developers to be smarter about data. Indeed, "Where batch jobs seldom last for more than a few hours, a streaming pipeline often runs continuously, and this always-on requirement is unprecedented in how developers have their applications interacting with real-time data," Brewer said.

 



Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
Open Source Site Aims to Boost Use of Machine Learning

Chief Analytics Officer Spring 2017

2
May
2017
Chief Analytics Officer Spring 2017

15% off with code MP15

Read Also:
Association Rule Mining – Not Your Typical Data Science Algorithm

Big Data and Analytics for Healthcare Philadelphia

17
May
2017
Big Data and Analytics for Healthcare Philadelphia

$200 off with code DATA200

Read Also:
Keys to Working With Big Data

SMX London

23
May
2017
SMX London

10% off with code 7WDATASMX

Read Also:
How to move beyond digital transformation
Read Also:
10 BI Mistakes That Could Be Killing Your Analytics Projects

Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
Big Data Gets Bigger: 5 Ways to Employ Legal Analytics

Leave a Reply

Your email address will not be published. Required fields are marked *