Welcome!

Machine Learning Authors: Yeshim Deniz, Elizabeth White, Pat Romanski, Liz McMillan, Shelly Palmer

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Machine Learning , @CloudExpo, @BigDataExpo

Microservices Expo: Article

Big Data Is Not Just About Marketing: Don’t Forget the IT Department’s Needs

Advances in machine intelligence bring new excitement and value

Few, if any, information technology subjects have garnered more attention over the past two years than Big Data. It's a savior. It's evil. It's the killer app of killer apps. And now, according to Gartner analyst Svetlana Sicular, "Big Data Is Falling into the Trough of Disillusionment."

This disillusionment is giving me a little bit of Big Data fatigue - at least in the sense that so much buzz is focused on what Big Data can do for marketing and business intelligence departments. Lost amid all the hype and hoopla is the story of how predictive analytics can help IT teams better understand and support the business applications that are the very lifeblood of their enterprise. After all, predicting the right service to offer your online customer won't help if the customer experiences sluggish application performance.

And Big Data is not going away. Big Data begets Very Big Data, and so on. Analysts are projecting that astronomical amounts of money will be spent on analyzing and using information. This includes projections that millions of data scientists are going to be hired to make sense of all this. You and I know that few if any of those data scientists will be monitoring application or infrastructure performance.

Application performance monitoring is a critical job that can substantially impact a company's brand and bottom line. The fact is that this is an incredibly tough assignment because of all the variables that can negatively impact performance. It is like telling an Ops pro, "You don't have to find a needle in a haystack; you have to find an unspecified number of needles in an unspecified number of haystacks." As databases and other apps get bigger and more distributed, this is almost impossible to do with human intelligence and traditional tools.

The good news is that predictive analytics for IT solutions are far simpler and increasingly more affordable than their Big Data counterparts. It is important for all of us to bang the drum louder about the business value that predictive analytics can provide for IT, not just for application performance, but for people performance too. The industry needs to discuss the risks of fielding powerful and complex applications without arming IT Ops and Support with similarly powerful tools to ensure their availability and performance.

Why Predictive Analytics for IT Is So Cool - and Worth Talking About
Most currently available analytical tools that can forecast human behavior give users exactly what they ask for - and that is part of the problem. The more variables you have in an equation, the more relationships exist. It's getting more difficult all the time to know what questions to ask.

The cutting edge of predictive analytics for IT uses advanced machine intelligence to scan data patterns to detect anomalies and other relationships that human analysts cannot see, at least not see quickly or without the help of data scientists. Using machine intelligence as part of IT performance management is like having your own personal R2D2, or an android like Star Trek's Lieutenant Commander Data. In fact, pairing machine intelligence with human intelligence is the future of problem solving and prediction - you can see it working today to identify root causes of performance failures and limit unplanned downtime. It is quite cool. There is hope for the disillusioned.

Additionally, the list of use cases for predictive analytics in IT is growing. We see organizations using it all the time to predict and prevent service disruptions. If something does go wrong, users can often find the source of the disruption much faster than they can with just human analysis. I have found that in some cases, machine intelligence can identify root causes of performance failures up to 90 percent faster than human intelligence alone can.

We can already see innovations on the near horizon that will make predictive analytics powered by advanced machine intelligence even better equipped to serve IT Ops' needs. Integrating performance management with security threat management is a good example. All of this is good news for IT Ops pros because their jobs are increasingly vital to an organization's success in this era of widely distributed infrastructures.

This is why companies have to emphasize the business value of predictive analytics for IT in conversations about application and infrastructure management. If you forget about IT Ops' needs when contemplating the deployment of data-heavy business applications, you put your network and your organization as a whole at risk.

Predictive analytics in IT is a breath of fresh air in the Big Data conversation. It gets me excited - far from being disillusioned.

More Stories By Mark Jaffe

Mark Jaffe is CEO of Prelert, the first company to provide 100% self-learning predictive analytics solutions to dramatically improve IT operations. He is a serial software entrepreneur who has been instrumental in the success of numerous software companies. Over his 23 years high tech experience, Jaffe has held leadership roles in product marketing, software sales and executive management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
For financial firms, the cloud is going to increasingly become a crucial part of dealing with customers over the next five years and beyond, particularly with the growing use and acceptance of virtual currencies. There are new data storage paradigms on the horizon that will deliver secure solutions for storing and moving sensitive financial data around the world without touching terrestrial networks. In his session at 20th Cloud Expo, Cliff Beek, President of Cloud Constellation Corporation, w...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs ofte...
SYS-CON Events announced today that Outscale, a global pure play Infrastructure as a Service provider and strategic partner of Dassault Systèmes, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2010, Outscale simplifies infrastructure complexities and boosts the business agility of its customers. Outscale delivers a secure, reliable and industrial strength solution for its customers, which in...
Cloud applications are seeing a deluge of requests to support the exploding advanced analytics market. “Open analytics” is the emerging strategy to deliver that data through an open data access layer, in the cloud, to be directly consumed by external analytics tools and popular programming languages. An increasing number of data engineers and data scientists use a variety of platforms and advanced analytics languages such as SAS, R, Python and Java, as well as frameworks such as Hadoop and Spark...
SYS-CON Events announced today that DivvyCloud will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. DivvyCloud software enables organizations to achieve their cloud computing goals by simplifying and automating security, compliance and cost optimization of public and private cloud infrastructure. Using DivvyCloud, customers can leverage programmatic Bots to identify and remediate common cloud problems in rea...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assis...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single threaded, you can effectively identify hot spots in your serverless code. In his session at 20th Cloud Expo, David Martin, Principal Product Owner at CA Technologies, will give a live demonstration and code walkthrough, showing how to ov...
Interested in leveling up on your Cloud Foundry skills? Join IBM for Cloud Foundry Days on June 7 at Cloud Expo New York at the Javits Center in New York City. Cloud Foundry Days is a free half day educational conference and networking event. Come find out why Cloud Foundry is the industry's fastest-growing and most adopted cloud application platform.
In order to meet the rapidly changing demands of today’s customers, companies are continually forced to redefine their business strategies in order to meet these needs, stay relevant and continue to see profitable growth. IoT deployment and development is integral in this transformation, and today businesses are increasingly seeing the value of investing their resources into IoT deployments. These technologies are able increase ROI through projects such as connecting supply chains or enabling sm...
SYS-CON Events announced today that delaPlex will exhibit at SYS-CON's @CloudExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. delaPlex pioneered Software Development as a Service (SDaaS), which provides scalable resources to build, test, and deploy software. It’s a fast and more reliable way to develop a new product or expand your in-house team.
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloudistics delivers a complete public cloud experience with composable on-premises infrastructures to medium and large enterprises. Its software-defined technology natively converges network, storage, compute, virtualization, and management into a ...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists will examine how DevOps helps to meet th...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
Every successful software product evolves from an idea to an enterprise system. Notably, the same way is passed by the product owner's company. In his session at 20th Cloud Expo, Oleg Lola, CEO of MobiDev, will provide a generalized overview of the evolution of a software product, the product owner, the needs that arise at various stages of this process, and the value brought by a software development partner to the product owner as a response to these needs.
SYS-CON Events announced today that A&I Solutions has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 1999, A&I Solutions is a leading information technology (IT) software and services provider focusing on best-in-class enterprise solutions. By partnering with industry leaders in technology, A&I assures customers high performance levels across all IT environments including: mai...
SYS-CON Events announced today that Tappest will exhibit MooseFS at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. MooseFS is a breakthrough concept in the storage industry. It allows you to secure stored data with either duplication or erasure coding using any server. The newest – 4.0 version of the software enables users to maintain the redundancy level with even 50% less hard drive space required. The software func...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software in the hope of capturing value in IoT. Although IoT is relatively new in the market, it has already gone through many promotional terms such as IoE, IoX, SDX, Edge/Fog, Mist Compute, etc. Ultimately, irrespective of the name, it is about deriving value from independent software assets participating in an ecosystem as one comprehensive solution.