| By Vu Lam | Article Rating: |
|
| December 21, 2012 12:00 PM EST | Reads: |
1,864 |
Software developers and service providers need a period of usability testing before launch to find out how the product stands up in the hands of end users. An experienced QA team will ferret out bugs and identify major issues, but they won't use your software like a customer will. The value of focus testing is not up for debate, but the way you run it most definitely is.
How Does It Work?
Crowdsourcing-based usability testing services is an emerging niche and you'll find a choice of online services capable of delivering valuable information on your product's usability. Try My UI and User Testing are two good examples and they both offer the chance to see potential customers using your software in real-world conditions. The pricing varies, but you're looking at $35 to $39 per tester for a single test and there are discounts for bulk orders.

You provide the software and a set of instructions and the testers complete the task you set out in their own homes. Their computer screens are recorded so you can see exactly what they are doing and they provide a running audio commentary to explain their thought process. This is a fantastic way to get detailed feedback and immediately identify any usability issues that you may have overlooked. Each video has a maximum time limit of 20 minutes.
Benefits over Traditional Usability Testing
The key benefit is obviously the cost savings, because traditional usability testing is very expensive. Crowdsourcing is actually superior in other ways as well. The turnaround is incredibly fast; you can get same-day results, potentially even within an hour, which would be impossible if you were setting up a series of tests with a focus group in a lab setting. You can also get feedback 24/7 so if time is a factor, or you want to enact quick changes and test again, you can do so.
Consider also the benefit of having testers who are for the most part working from home and therefore relaxed and without expectations. The process of coming into an unfamiliar setting for a test can actually skew the results. With this kind of online testing you are really getting as close to an end-user experience as possible.
What's the Downside?
No solution is ever perfect and so it's important to mention a couple of limitations. This kind of testing in 20-minute chunks is best suited to examining how users interact with a menu or interface system, or how they perform a relatively simple task with your software. There isn't time to go into any great depth.
You also have to consider the demographic you need. You'll find the option to choose an age range, average household income, country, gender, level of expertise, and you can add more stringent guidelines. The system is not ideal if you have very specific needs. For in-depth screening to pinpoint a real niche bracket of testers, you will need to look elsewhere.
The Proof Is in the Testing
With such a low upfront cost and quick turnaround there really is no reason not to give it a try. Any feedback that enables you to streamline your product and improve usability is worth the investment. You can easily annotate or edit the videos you get in from testers and that can be a useful tool to present your findings to the rest of your company and spark the response you need to perfect that software before it goes to market.
Published December 21, 2012 Reads 1,864
Copyright © 2012 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Vu Lam
Vu Lam is founder and CEO of QASymphony, developers of defect capture tools that track user interactions with applications. He was previously with First Consulting Group and was an early pioneer in Vietnam’s offshore IT services industry since 1995. He holds an MS degree in electrical engineering from Purdue University. You may reach him at vulam@qasymphony.com.
- Cloud People: A Who's Who of Cloud Computing
- AMD and Adobe Collaborate on Upcoming Version of Adobe Premiere Pro Software to Enable Breakthrough Video Editing Performance Through Open Standards
- New Relic Q1 2013 Blazes Past Growth Targets and Reaches 40,000 Active Customer Accounts
- Predixion Software Announces General Availability of the Latest Version of its Predictive Analytics Platform
- Social Loginwall Failure
- Five Big Data Features in SQL Server
- MicroStrategy Announces General Availability of MicroStrategy 9.3.1
- Cloud Expo NY: Cloud & Location-Aware Big Data Is Changing Our World
- How Bon-Ton Stores Align Business Goals with IT Requirements
- MicroStrategy Announces General Availability of MicroStrategy 9.3.1
- WordsEye Announces Upcoming Beta of a First-of-Its-Kind Text-to-Scene Application
- From Creative Cloud to iCloud – Kevin Lynch Leaves Adobe for Apple
- Cloud People: A Who's Who of Cloud Computing
- AMD and Adobe Collaborate on Upcoming Version of Adobe Premiere Pro Software to Enable Breakthrough Video Editing Performance Through Open Standards
- New Relic Q1 2013 Blazes Past Growth Targets and Reaches 40,000 Active Customer Accounts
- Predixion Software Announces General Availability of the Latest Version of its Predictive Analytics Platform
- Book Excerpt: jQuery Essentials | Part 1
- Red Hat Reinforces Java Commitment
- Social Loginwall Failure
- VCE Revisited, Now and Zen
- Five Steps Toward Achieving Better Compliance with Identity Analytics
- Five Big Data Features in SQL Server
- Development Testing for Java Applications
- Oracle Appeals Java Decision
- Building a Drag-and-Drop Shopping Cart with AJAX
- What Is AJAX?
- Google Maps! AJAX-Style Web Development Using ASP.NET
- Flashback to January 2006: Exclusive SYS-CON.TV Interviews on "OpenAjax Alliance" Announcement
- How and Why AJAX, Not Java, Became the Favored Technology for Rich Internet Applications
- Where Are RIA Technologies Headed in 2008?
- AJAXWorld Conference & Expo to Take Place October 2-4, 2006, at the Santa Clara Convention Center, California
- "Real-World AJAX" One-Day Seminar Arrives in Silicon Valley
- AJAX Sponsor Webcasts Are Now Available at AJAXWorld Website
- AJAXWorld University Announces AJAX Developer Bootcamp
- AJAX Support In JadeLiquid WebRenderer v3.1
- Struts Validations Framework Using AJAX
May. 18, 2013 05:00 AM EDT Reads: 2,051 |
By Jeremy Geelan
Cloud enables SMBs to access new, scalable resources – previously only available to enterprises – in flexible and cost-effective ways. McKinsey’s SMB Cloud Report projects the public cloud market to reach $40-$50 billion by 2015, with SMBs comprising 65% of public cloud spending in 2015. But selling cloud to SMBs raises the questions of who, what and how.
In this session Manjula Talreja, VP of Cisco’s Global Cloud Business Development Team, will discuss the importance of knowing who SMB...May. 18, 2013 02:00 AM EDT Reads: 694 |
By Pat Romanski Compelling consumer applications are created every day. Are you ready for the IT implications both internally and externally? As your datacenter needs more capacity, the cloud will be critical to success. What are the key considerations to help plan for the needed capacity over time? And how can the cloud best work with your existing applications?
In his General Session at the 12th International Cloud Expo, Brian Jawalka, Enterprise Solutions Architect at Rackspace Hosting, will open conversat...May. 17, 2013 02:00 PM EDT Reads: 1,379 |
By Liz McMillan Cloud computing is more than a buzz-phrase it’s a transformative IT paradigm shift. The emphasis in the cloud is on elasticity, scalability, agility and open. Not just open standards but open APIs and open source. The delivery of software is also going through a paradigm shift. Open source software was often a commoditization of a market leader; Unix to Linux or Oracle to MySQL what’s changing is that the iterative nature, user context and the motto of releasing early and often are driving real ...May. 17, 2013 01:15 PM EDT Reads: 1,213 |
By Jeremy Geelan May. 17, 2013 12:00 PM EDT Reads: 2,571 |
By Pat Romanski SYS-CON Events announced today that MetraTech Corp., the leading provider of agreements-based billing™, commerce and compensation solutions, has been named “Bronze Sponsor” of SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York.
MetraTech Corp. is the leading provider of commerce, billing and compensation solutions enabling customers to monetize relationships with customers, partners, and suppliers. Its unique Agree...May. 17, 2013 12:00 PM EDT Reads: 1,170 |
By Elizabeth White Storage and Archive offerings are now exploding on the market. From end-user mobile devices to company tactical level, the cloud has become a black hole for every kind of data. But what are the risks, and what are the real needs?
In his session at the 12th International Cloud Expo, Alexandre Morel, Cloud Product Manager & Evangelist at OVH.com, will answer questions such as:
How to develop a strategy to use those offers as a base to develop mid and long-term value?
Should companies trust th...May. 17, 2013 11:30 AM EDT Reads: 1,131 |
By Liz McMillan Enterprise cloud adoption revolves around pushing the BYOD movement and focusing on data security.
In his session at the 12th International Cloud Expo, Ross Brouse, COO and President of Solar VPS, will cover how cloud adoption is driven by consumerism, humanity’s need to socialize, our addiction to new gadgets and the ability of data to stay secure in a growing collaborative world. The cloud is a drug and we’re just getting hooked.
Ross Brouse is the COO and President of Solar VPS. He is a tr...May. 17, 2013 11:30 AM EDT Reads: 956 |
By Elizabeth White How your organization approaches capacity management will make or break your private cloud initiative. No longer a periodic sizing exercise, capacity management is now an essential element of daily infrastructure operations that impacts costs, performance risks, and the ability to respond to new workload requests.
In his session at the 12th International Cloud Expo, Andrew Hillier, Co-Founder & CTO of CiRBA, will show how to integrate next-generation capacity control with cloud stacks, includi...May. 17, 2013 11:00 AM EDT Reads: 1,146 |
By Liz McMillan SYS-CON Events announced today that Intrinsic-ID, a provider of top-level security solutions, will exhibit at SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York.
Intrinsic-ID’s software application Saturnus® offers users total data security in the cloud. With the application users can securely access, share and store their data in the cloud. They can use it anytime, anywhere and on any device. With Saturnus® users ...May. 17, 2013 11:00 AM EDT Reads: 1,330 |








Cloud enables SMBs to access new, scalable resources – previously only available to enterprises – in flexible and cost-effective ways. McKinsey’s SMB Cloud Report projects the public cloud market to reach $40-$50 billion by 2015, with SMBs comprising 65% of public cloud spending in 2015. But selling cloud to SMBs raises the questions of who, what and how.
In this session Manjula Talreja, VP of Cisco’s Global Cloud Business Development Team, will discuss the importance of knowing who SMB...
Compelling consumer applications are created every day. Are you ready for the IT implications both internally and externally? As your datacenter needs more capacity, the cloud will be critical to success. What are the key considerations to help plan for the needed capacity over time? And how can the cloud best work with your existing applications?
In his General Session at the 12th International Cloud Expo, Brian Jawalka, Enterprise Solutions Architect at Rackspace Hosting, will open conversat...
Cloud computing is more than a buzz-phrase it’s a transformative IT paradigm shift. The emphasis in the cloud is on elasticity, scalability, agility and open. Not just open standards but open APIs and open source. The delivery of software is also going through a paradigm shift. Open source software was often a commoditization of a market leader; Unix to Linux or Oracle to MySQL what’s changing is that the iterative nature, user context and the motto of releasing early and often are driving real ...
SYS-CON Events announced today that MetraTech Corp., the leading provider of agreements-based billing™, commerce and compensation solutions, has been named “Bronze Sponsor” of SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York.
MetraTech Corp. is the leading provider of commerce, billing and compensation solutions enabling customers to monetize relationships with customers, partners, and suppliers. Its unique Agree...
Storage and Archive offerings are now exploding on the market. From end-user mobile devices to company tactical level, the cloud has become a black hole for every kind of data. But what are the risks, and what are the real needs?
In his session at the 12th International Cloud Expo, Alexandre Morel, Cloud Product Manager & Evangelist at OVH.com, will answer questions such as:
How to develop a strategy to use those offers as a base to develop mid and long-term value?
Should companies trust th...
Enterprise cloud adoption revolves around pushing the BYOD movement and focusing on data security.
In his session at the 12th International Cloud Expo, Ross Brouse, COO and President of Solar VPS, will cover how cloud adoption is driven by consumerism, humanity’s need to socialize, our addiction to new gadgets and the ability of data to stay secure in a growing collaborative world. The cloud is a drug and we’re just getting hooked.
Ross Brouse is the COO and President of Solar VPS. He is a tr...
How your organization approaches capacity management will make or break your private cloud initiative. No longer a periodic sizing exercise, capacity management is now an essential element of daily infrastructure operations that impacts costs, performance risks, and the ability to respond to new workload requests.
In his session at the 12th International Cloud Expo, Andrew Hillier, Co-Founder & CTO of CiRBA, will show how to integrate next-generation capacity control with cloud stacks, includi...
SYS-CON Events announced today that Intrinsic-ID, a provider of top-level security solutions, will exhibit at SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York.
Intrinsic-ID’s software application Saturnus® offers users total data security in the cloud. With the application users can securely access, share and store their data in the cloud. They can use it anytime, anywhere and on any device. With Saturnus® users ...
New technologies allow schools, colleges and universities to analyze absolutely everything that happens. From student behavior, testing results, career development of students as well as educational needs based on changing societies. A lot of this data has already been stored and is used for statist...
In the coming years, big data will change the way organisations and societies are operated and managed. Big data however, is not the only trend that will impact significantly how organisations operate. Another major trend at the moment is gamification. Gamification will change the way organisations ...
We all talk about cloud differently, but is there a way we should be speaking about this tech?
Cloud computing is now a widely reported, if not accepted, IT movement that, depending on who you talk to, has changed or is changing the way businesses utilize infrastructure.
A recent Gartner study states that the function of the modern CIO is in flux and that his or her future focus must incorporate digital assets (aka cloud-based data and applications) to remain relevant. Towards the goal of riding the sea change a compiler of stacks to a broker of business needs, secu...
The age of data center automation is upon us. Whether it's cloud or SDN or devops in general, automation as a means to achieve efficiency and, one hopes, free up resources that can be then redirected to focus on innovation.
As is always the case when we begin to move further upwards, abstracting ...
Windows Azure Virtual Networks offers the power to open up several cross-premises use case scenarios, including Active Directory Disaster Recovery, SQL Database Replication, Windows Server 2012 DFS-R File Replication, Accelerated Cloud File Services with BranchCache, Hybrid Web Applications and MORE...
As the infrastructure cloud market (IaaS and PaaS) continues to grow rapidly, we are seeing quite a few customers who are delivering an application – whether it is a mission-critical or SaaS application – and basing their solution on VMware.
VMware Security Cloud Encryption cloud keyboard Cloud Enc...
Have you heard of products like IBM’s InfoSphere Streams, Tibco’s Event Processing product, or Oracle’s CEP product? All good examples of commercially available stream processing technologies which help you process events in real-time.
I’ve been asked what I consider as “Big Data” versus “Small Dat...
My fellow Technical Evangelists and I have authored a content series that steps through building your very own Private Cloud by leveraging Windows Server 2012, our FREE Hyper-V Server 2012, Windows Azure Infrastructure Services ( IaaS ) and System Center 2012 Service Pack 1.
Week-by-week, we walk ...










