Welcome!

Machine Learning Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Elizabeth White, Corey Roth

Related Topics: Java IoT, Industrial IoT, Microservices Expo, Microsoft Cloud, Machine Learning , Agile Computing

Java IoT: Article

Analyzing Shades of Grey

...It’s no longer about red, yellow and green

Over the last year there have been an influx of new graphical user interfaces (UIs) as monitoring and dashboard vendors scramble to keep up with large enterprises increasingly focused on understanding the business impact of IT, and Netuitive is no exception.

Today’s enterprises are challenged with monitoring and interpreting increasing volumes of infrastructure performance, application data, and business metrics.  Like Big Data, advanced predictive analytics have moved to the forefront for their ability to identify anomalies that could lead to business and revenue impacting performance problems.  As such, the UIs visualization capabilities have become an increasingly important means to this end, and ultimately to proactive management of critical application performance.

But to understand where the UI is now, and where it must go, one must look back at how APM use cases have evolved and changed.

In the “old” world, the Big Four and APM tool vendors developed dashboards that monitored individual data sources visualizing results in green, yellow, and red buttons, bar charts, and pie graphs.  Basically, all these did was show when a server or storage platform was either over-utilized or broken, and that you needed to physically add capacity and/or replace it.  They were no sophisticated algorithms and it was up to the user to interpret any impact on IT performance now and in the future.

Over time, data sources continued to increase in volume and variety, virtualization happened, and complexity increased to the point of making it  humanly impossible to monitor and interpret IT and application performance … let alone understand business impact.

To address this, IT operations, particularly those large enterprises with mission critical applications, began using IT analytics to monitor real-time data and metrics to identify anomalies that were leading indicators of future performance problems.

Fast forward to 2013.  The volume of performance and application data and metrics are orders of magnitude higher and IT operations analytics are now central to any advanced monitoring strategy. As such, the demands on the monitoring tools have changed significantly.  It is no longer simply about green, yellow and red buttons.  While they are still primary indicators of the “health” of an application or business service, it is now about being able to process and automate the analysis and correlation of multiple data types with analytics that detect and interpret anomalies.  Today’s tools can store and process large quantities of information.  Advanced algorithms assist in highly synthesized, meaningful visualization that you can use it for decision support.

However, the industry overall is still struggling to develop processing that is sophisticated enough to identify the “anomaly in a haystack” that may be the key indicator of future performance degradation and/or service interruption.

The focus is now on developing UIs that assist in the detection of anomalies and allow you to act on them in real time.  And not every anomaly is a problem.  You need to be able to filter them.  And when an anomaly does happen, you need to quickly determine 1) whether or not this anomaly is going to lead to a real problem? 2) and if it is an early indicator, what do you do about it? The new UIs are focused on helping you address that.

In Netuitive’s case, we focus on the IT infrastructure, application data, and key business metrics associated with a particular mission critical application or business service with the goal of understanding business impact.  We integrate our predictive analytics technologies as part of large scale APM monitoring solutions that focus on the key IT performance, application data, and business metrics for a particular business service instead of trying to boil the ocean across the enterprise. We bring all of this analysis and correlation for a particular business service or application together in our new UI that visualizes the correlation of IT performance, application data and key business metrics in a single screen at your fingertips.  It also integrates with local knowledge bases to further extend its ability to distinguish between true anomalies and known trends based on historical behaviors.   It is essentially a bridge from the old approach to the new.

Looking forward the UI will need to continue to evolve. Data will continue to increase, analytics will need better algorithms, and the goal will continue to be about finding anomalies and addressing them before an issue cascaded into a larger performance problem or service interruption.  The UI will need to process large amounts of data and help you determine if an anomaly is a problem or just an anomaly, and what do you do about it…proactively.

Ultimately it is this proactive approach that allows you to prevent impact on the business.  And to achieve this, the new UIs need to help you understand the impact on the business.

More Stories By Marcus Jackson

Marcus is Director of Product Management at Netuitive. He is responsible for the direction of Netuitive's flagship product, including analytics and data visualization. He has over 20 years of experience in software engineering and performance management. Previously, he headed development for Netuitive and the IEEE Computer Society. Marcus holds a bachelor's degree in Computer Science from Harvard University.

@CloudExpo Stories
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and ...
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smart...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
DXWorldEXPO LLC announced today that ICC-USA, a computer systems integrator and server manufacturing company focused on developing products and product appliances, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City. ICC is a computer systems integrator and server manufacturing company focused on developing products and product appliances to meet a wide range of ...
Sanjeev Sharma Joins November 11-13, 2018 @DevOpsSummit at @CloudEXPO New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
As Cybric's Chief Technology Officer, Mike D. Kail is responsible for the strategic vision and technical direction of the platform. Prior to founding Cybric, Mike was Yahoo's CIO and SVP of Infrastructure, where he led the IT and Data Center functions for the company. He has more than 24 years of IT Operations experience with a focus on highly-scalable architectures.
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, m...
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Venafi has a platform that allows you to manage, centralize and automate the complete life cycle of keys and certificates within the organization," explained Gina Osmond, Sr. Field Marketing Manager at Venafi, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...