Welcome!

Machine Learning Authors: Pat Romanski, Liz McMillan, Elizabeth White, Carmen Gonzalez, Ed Featherston

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Microsoft Cloud, Machine Learning , Agile Computing, Apache

Microservices Expo: Article

Case Study: Preventing Site Outages During the Holiday Rush

Performance testing in advance of trigger points can save your customer relations

This time of year, many companies are now in the process of conducting web load testing in advance of the holidays. In this article, you'll learn details on how a large online retailer conducted web load testing in advance of the holiday spike in traffic - and they're moving into the holiday season more confidently than ever.

Why This ‘Retailer' Came to Compuware
As a leading retailer of personalized gifts, it needed to ensure that its website would be ready for the 2012 holidays. Despite load testing its site last year with a different vendor, The Retailer experienced several outages during peak traffic, costing them significant revenue. Great customer experiences and relationships are very important to this Retailer - both in-store and online. However, as a result of the site outages, customer relationships were impacted both online and in its brick and mortar locations.

In order to provide its customers with great experiences, and protect its reputation, the Retailer's online store has to not only provide a great shopping experience, but also withstand the traffic spikes caused by seasonal upswings, events and promotions. Since performance directly impacts the business, much is riding on the performance of its website during the critical holiday season.

Understandably, leery of promises about ensuring scalability after last years' experience, the Retailer contacted Compuware to engage services to deploy its Gomez 360o Web Load Testing solution which was selected based on three key factors:

  • Enough Load could be generated from enough locations to thoroughly stress its system;
  • Real browser technology for the agents would ensure the most realistic testing and problem identification; and
  • The diagnostic capabilities of dynaTrace's PurePath technology would show the root cause of any problem

The Retailer utilized Compuware Professional services in order to have an independent third-party that would help them design a test plan to re-create issues, not just prove that the system worked.

With Gomez 360o Web Load Testing, each transaction performed during load testing was traced. In addition, all of the diagnostic information correlated into load test reports so there was complete visibility into how applications behaved under load. Armed with this information, the Retailer identified any problems in both proprietary code as well as third-party code.

Retailer's Plan of Attack

  • Test from the end-user perspective using last mile, real browsers and less than ideal Internet speeds.
  • Test the production system during least use in the middle of the night giving a four hour test window with normal peaks lasting approximately 10 hours
  • Calculate load volume based on highest hourly historical activity - then multiply the test window by 2.5 to obtain a 10 hour peak.

Results
The Retailer's site could handle the peak load but not for the allotted four hours. The analysis revealed multiple root causes of instability including:

  • Load balancer issues
  • Gateway errors
  • SQL issues
  • JVM Issues

Reconfiguring the load balancer solved the site crashes while code changes optimized certain queries. JVM optimization was taken care of by forcing garbage collection more frequently.

The quality and speed of the Retailer's website is now on par to provide exceptional user experiences for their e-commerce customers, aligning it with the caliber of in-store service that is expected. The Retailer was also able to reduce testing iterations and cycle time with proactive problem resolution and prevention and validate that the website architecture is performing properly for maximum scalability under peak load.

Actionable data is easily provided to their outsourced development vendor. This not only gives the vendor a deep, code level view in order to quickly fix and optimize the application code, but relations between the vendor and the retailer are greatly improved since the data eliminates finger pointing.

The Retailer is confident it will not have a repeat of last year's outages and its site will perform optimally during peak traffic periods throughout the holiday season.

To learn how performance testing in advance of trigger points can save your customer relations, attend our live webcast with Forrester's Peter Wannemacher on Thursday, Nov. 15.

More Stories By Laura Strassman

Laura Strassman has more than 20 years of experience in product management and marketing in the technology space, and has focused extensively in the application performance area. At SmartBear, she is responsible for technical content strategy and programs for AlertSite UXM, the company’s industry-leading user experience and performance monitoring platform. Prior to SmartBear, Strassman held positions at companies in the application performance, digital video, speech recognition and software development tool markets.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that Twistlock, the leading provider of cloud container security solutions, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Twistlock is the industry's first enterprise security suite for container security. Twistlock's technology addresses risks on the host and within the application of the container, enabling enterprises to consistently enforce security policies, monitor...
Quickly find the root cause of complex database problems slowing down your applications. Up to 88% of all application performance issues are related to the database. DPA’s unique response time analysis shows you exactly what needs fixing - in four clicks or less. Optimize performance anywhere. Database Performance Analyzer monitors on-premises, on VMware®, and in the Cloud, including Amazon® AWS and Azure™ virtual machines.
Automation is enabling enterprises to design, deploy, and manage more complex, hybrid cloud environments. Yet the people who manage these environments must be trained in and understanding these environments better than ever before. A new era of analytics and cognitive computing is adding intelligence, but also more complexity, to these cloud environments. How smart is your cloud? How smart should it be? In this power panel at 20th Cloud Expo, moderated by Conference Chair Roger Strukhoff, pane...
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busin...
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
@ThingsExpo has been named the Most Influential ‘Smart Cities - IIoT' Account and @BigDataExpo has been named fourteenth by Right Relevance (RR), which provides curated information and intelligence on approximately 50,000 topics. In addition, Right Relevance provides an Insights offering that combines the above Topics and Influencers information with real time conversations to provide actionable intelligence with visualizations to enable decision making. The Insights service is applicable to eve...
SYS-CON Events announced today that Grape Up will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company specializing in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the U.S. and Europe, Grape Up works with a variety of customers from emergi...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
Bert Loomis was a visionary. This general session will highlight how Bert Loomis and people like him inspire us to build great things with small inventions. In their general session at 19th Cloud Expo, Harold Hannon, Architect at IBM Bluemix, and Michael O'Neill, Strategic Business Development at Nvidia, discussed the accelerating pace of AI development and how IBM Cloud and NVIDIA are partnering to bring AI capabilities to "every day," on-demand. They also reviewed two "free infrastructure" pr...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists will examine how DevOps helps to meet th...
SYS-CON Events announced today that Hitachi, the leading provider the Internet of Things and Digital Transformation, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Hitachi Data Systems, a wholly owned subsidiary of Hitachi, Ltd., offers an integrated portfolio of services and solutions that enable digital transformation through enhanced data management, governance, mobility and analytics. We help globa...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and 21st International Cloud Expo, which will take place in November in Silicon Valley, California.
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deli...
@DevOpsSummit has been named the ‘Top DevOps Influencer' by iTrend. iTred processes millions of conversations, tweets, interactions, news articles, press releases, blog posts - and extract meaning form them and analyzes mobile and desktop software platforms used to communicate, various metadata (such as geo location), and automation tools. In overall placement, @DevOpsSummit ranked as the number one ‘DevOps Influencer' followed by @CloudExpo at third, and @MicroservicesE at 24th.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, June 6-8, 2017, at the Javits Center in New York City, NY and October 31 - November 2, 2017, Santa Clara Convention Center, CA. Learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
Developers want to create better apps faster. Static clouds are giving way to scalable systems, with dynamic resource allocation and application monitoring. You won't hear that chant from users on any picket line, but helping developers to create better apps faster is the mission of Lee Atchison, principal cloud architect and advocate at New Relic Inc., based in San Francisco. His singular job is to understand and drive the industry in the areas of cloud architecture, microservices, scalability ...
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...