Machine Learning Authors: Zakia Bouachraoui, Yeshim Deniz, Elizabeth White, Pat Romanski, Liz McMillan

Related Topics: Java IoT, Industrial IoT, Microservices Expo, Microsoft Cloud, Machine Learning , Agile Computing

Java IoT: Article

Analyzing Shades of Grey

...It’s no longer about red, yellow and green

Over the last year there have been an influx of new graphical user interfaces (UIs) as monitoring and dashboard vendors scramble to keep up with large enterprises increasingly focused on understanding the business impact of IT, and Netuitive is no exception.

Today’s enterprises are challenged with monitoring and interpreting increasing volumes of infrastructure performance, application data, and business metrics.  Like Big Data, advanced predictive analytics have moved to the forefront for their ability to identify anomalies that could lead to business and revenue impacting performance problems.  As such, the UIs visualization capabilities have become an increasingly important means to this end, and ultimately to proactive management of critical application performance.

But to understand where the UI is now, and where it must go, one must look back at how APM use cases have evolved and changed.

In the “old” world, the Big Four and APM tool vendors developed dashboards that monitored individual data sources visualizing results in green, yellow, and red buttons, bar charts, and pie graphs.  Basically, all these did was show when a server or storage platform was either over-utilized or broken, and that you needed to physically add capacity and/or replace it.  They were no sophisticated algorithms and it was up to the user to interpret any impact on IT performance now and in the future.

Over time, data sources continued to increase in volume and variety, virtualization happened, and complexity increased to the point of making it  humanly impossible to monitor and interpret IT and application performance … let alone understand business impact.

To address this, IT operations, particularly those large enterprises with mission critical applications, began using IT analytics to monitor real-time data and metrics to identify anomalies that were leading indicators of future performance problems.

Fast forward to 2013.  The volume of performance and application data and metrics are orders of magnitude higher and IT operations analytics are now central to any advanced monitoring strategy. As such, the demands on the monitoring tools have changed significantly.  It is no longer simply about green, yellow and red buttons.  While they are still primary indicators of the “health” of an application or business service, it is now about being able to process and automate the analysis and correlation of multiple data types with analytics that detect and interpret anomalies.  Today’s tools can store and process large quantities of information.  Advanced algorithms assist in highly synthesized, meaningful visualization that you can use it for decision support.

However, the industry overall is still struggling to develop processing that is sophisticated enough to identify the “anomaly in a haystack” that may be the key indicator of future performance degradation and/or service interruption.

The focus is now on developing UIs that assist in the detection of anomalies and allow you to act on them in real time.  And not every anomaly is a problem.  You need to be able to filter them.  And when an anomaly does happen, you need to quickly determine 1) whether or not this anomaly is going to lead to a real problem? 2) and if it is an early indicator, what do you do about it? The new UIs are focused on helping you address that.

In Netuitive’s case, we focus on the IT infrastructure, application data, and key business metrics associated with a particular mission critical application or business service with the goal of understanding business impact.  We integrate our predictive analytics technologies as part of large scale APM monitoring solutions that focus on the key IT performance, application data, and business metrics for a particular business service instead of trying to boil the ocean across the enterprise. We bring all of this analysis and correlation for a particular business service or application together in our new UI that visualizes the correlation of IT performance, application data and key business metrics in a single screen at your fingertips.  It also integrates with local knowledge bases to further extend its ability to distinguish between true anomalies and known trends based on historical behaviors.   It is essentially a bridge from the old approach to the new.

Looking forward the UI will need to continue to evolve. Data will continue to increase, analytics will need better algorithms, and the goal will continue to be about finding anomalies and addressing them before an issue cascaded into a larger performance problem or service interruption.  The UI will need to process large amounts of data and help you determine if an anomaly is a problem or just an anomaly, and what do you do about it…proactively.

Ultimately it is this proactive approach that allows you to prevent impact on the business.  And to achieve this, the new UIs need to help you understand the impact on the business.

More Stories By Marcus Jackson

Marcus is Director of Product Management at Netuitive. He is responsible for the direction of Netuitive's flagship product, including analytics and data visualization. He has over 20 years of experience in software engineering and performance management. Previously, he headed development for Netuitive and the IEEE Computer Society. Marcus holds a bachelor's degree in Computer Science from Harvard University.

CloudEXPO Stories
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a multi-faceted approach of strategy and enterprise business development. Andrew graduated from Loyola University in Maryland and University of Auckland with degrees in economics and international finance.
Whenever a new technology hits the high points of hype, everyone starts talking about it like it will solve all their business problems. Blockchain is one of those technologies. According to Gartner's latest report on the hype cycle of emerging technologies, blockchain has just passed the peak of their hype cycle curve. If you read the news articles about it, one would think it has taken over the technology world. No disruptive technology is without its challenges and potential impediments that frequently get lost in the hype. The panel will discuss their perspective on what they see as they key challenges and/or impediments to adoption, and how they see those issues could be resolved or mitigated.
In today's always-on world, customer expectations have changed. Competitive differentiation is delivered through rapid software innovations, the ability to respond to issues quickly and by releasing high-quality code with minimal interruptions. DevOps isn't some far off goal; it's methodologies and practices are a response to this demand. The demand to go faster. The demand for more uptime. The demand to innovate. In this keynote, we will cover the Nutanix Developer Stack. Built from the foundation of software-defined infrastructure, Nutanix has rapidly expanded into full application lifecycle management across any infrastructure or cloud .Join us as we delve into how the Nutanix Developer Stack makes it easy to build hybrid cloud applications by weaving DBaaS, micro segmentation, event driven lifecycle operations, and both financial and cloud governance together into a single unified st...
SAP is the world leader in enterprise applications in terms of software and software-related service revenue. Based on market capitalization, we are the world's third largest independent software manufacturer. Harness the power of your data and accelerate trusted outcome-driven innovation by developing intelligent and live solutions for real-time decisions and actions on a single data copy. Support next-generation transactional and analytical processing with a broad set of advanced analytics - run securely across hybrid and multicloud environments.
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also received the prestigious Outstanding Technical Achievement Award three times - an accomplishment befitting only the most innovative thinkers. Shankar Kalyana is among the most respected strategists in the global technology industry. As CTO, with over 32 years of IT experience, Mr. Kalyana has architected, designed, developed, and implemented custom and packaged software solutions across a vast spectrum o...