Welcome!

Machine Learning Authors: William Schmarzo, Elizabeth White, Liz McMillan, Pat Romanski, James Carlini

Related Topics: Java IoT, Microservices Expo, Microsoft Cloud, Machine Learning , Agile Computing, @DXWorldExpo, @DevOpsSummit

Java IoT: Article

DevOps Is Changing the M in APM

Performance requires management – not monitoring

There has been a lot of talk among vendors and industry experts in the last year about how APM fits in with the DevOps philosophy. There have been many claims that because a vendor is easy to install and use, it automatically make it a solution catered for a DevOps crowd. This can't be further from the truth. Most vendors provide simple monitoring solutions that provide alerts on performance degradations.

The problem is that to do performance properly in a DevOps setting you have to transition away from monitoring the performance of an application and start managing it -not just in the production environment, but across all phases of the software development and deployment process. DevOps is also about the equal share of application ownership between development, testing and operations teams. In order to share ownership you have to share a common language - a common set of tools and data - that is automated and integrated in your continuous application deployment process. But what does that really look like? Here is our perspective.

Management Requires Collaboration; Monitoring Does Not.
Application Performance Management involves a level of work and commitment that requires development, testing, and operations teams to work together. This is the minimum level of collaboration needed to accomplish the successful launch of an application. Anything less falls under the alternate "M" - Monitoring.

Monitoring fails because it only serves the operations group and the other two play damage control by reacting to the alerts. Most vendors take an approach that assumes collaboration is the sharing of a screen print, a report, or a log file. This does not offer any details about the problem(s) other than the limited information contained in an aggregated view. Imagine someone looking at a picture of the Eiffel Tower and claiming they have been there because they've "seen" it. Would you collaborate with this person in planning your dream vacation to Paris?

In order to have good collaboration you have to have a platform that everyone can agree on and adhere to. The same is true for application performance. Having the same rich data at all levels enables everyone to work together on solving the problem, without questions about the data or needless and time-consuming requests for more information.

Rich data that everyone understands and that everyone can access is mandatory for cross team collaboration and allows you to quickly identify the root cause of the problem

Management Requires Expertise; Monitoring Does Not
The trend in APM right now is to simplify everything. Less clicks, less data, more answers. That makes sense. You want to simplify things like implementation and management. You need automation around the detection of applications and the components that support them. The problem is that some vendors take it to an extreme by focusing on a few key use cases. This limits the power to really solve complex problems.

When a vendor claims that they have made it "so easy that you never need help installing or running it " it means they have limited functionality and can only find the top three use cases that most organizations run into. It has been cooked down to offer a big punch for the glaring issues but after the fires are put out you are back to simply monitoring until the next fire.

Doing performance management is hard because you have to work with countless unique use cases and needs. Performance management requires having rich data that can be extracted for the diverse needs of different teams. It requires having performance experts who can educate and advise on how to use a performance platform that can integrate with the tools used along the agile development process. This does not mean the management software is difficult to deploy; that should still be easy. It simply means the management software is a part of the process already observed.

Rich Data allows going beyond Top Three Performance Problem Pattern Analysis. It allows you to solve and prevent a major impact of real end-user problems

Management Prevents Problems; Monitoring Does Not
Most vendors rattle sabers around trying to find problems in production. They like to claim how easy and simple their tools are by honing in on those common use cases. In doing so they make themselves into what they really are - just another fire extinguisher arriving too late to the blaze. A monitoring tool will only alert you when a fire occurs and the general neighborhood it happened in. They are no different than the predecessors they claim to replace. They are merely an easier design with an ergonomic grip and do nothing innovative save refurbish the previous generation's fire extinguisher.

To do performance management you have to have a solution in place that is designed from the ground up to help prevent fires and not put them out. In order to do that the platform must not only integrate with the tools used to develop and deploy software but also help integrate into the processes in which they are managed and positioned.

Prevent problems by managing key performance indicators in your development and continuous integration environment

While you can use this platform in production to put out fires, you are not limited to the "damage control" approach. After all, you don't want to be stuck with putting out fires all the time; you want to prevent them from happening. You can build on success and start to reap the long-term value of transforming your performance process, which will help streamline the progression and maximize efficiency.

The real question is do you want to monitor you application or do you want to manage it?

More Stories By Stephen Wilson

Stephen Wilson is a 15 year IT professional that currently holds the Subject Matter Expert role for Compuware APM within the Field Technology Sales organization. His role puts him in front of customers and their challenges on a daily basis. His background includes both development and operations. This kind of insight into the challenges that both developers face as well as those faced by the operational team allows him to be seen as a trusted advisor to his customers. His unique perspective into client needs and goals give creditability to the need for performance not just at one level but across the entire lifecycle.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
Vulnerability management is vital for large companies that need to secure containers across thousands of hosts, but many struggle to understand how exposed they are when they discover a new high security vulnerability. In his session at 21st Cloud Expo, John Morello, CTO of Twistlock, addressed this pressing concern by introducing the concept of the “Vulnerability Risk Tree API,” which brings all the data together in a simple REST endpoint, allowing companies to easily grasp the severity of the ...
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, discussed how data centers of the future will be managed, how the p...
"NetApp is known as a data management leader but we do a lot more than just data management on-prem with the data centers of our customers. We're also big in the hybrid cloud," explained Wes Talbert, Principal Architect at NetApp, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventio...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"ZeroStack is a startup in Silicon Valley. We're solving a very interesting problem around bringing public cloud convenience with private cloud control for enterprises and mid-size companies," explained Kamesh Pemmaraju, VP of Product Management at ZeroStack, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Codigm is based on the cloud and we are here to explore marketing opportunities in America. Our mission is to make an ecosystem of the SW environment that anyone can understand, learn, teach, and develop the SW on the cloud," explained Sung Tae Ryu, CEO of Codigm, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Data scientists must access high-performance computing resources across a wide-area network. To achieve cloud-based HPC visualization, researchers must transfer datasets and visualization results efficiently. HPC clusters now compute GPU-accelerated visualization in the cloud cluster. To efficiently display results remotely, a high-performance, low-latency protocol transfers the display from the cluster to a remote desktop. Further, tools to easily mount remote datasets and efficiently transfer...
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, discussed how by using ne...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...