Remote Testing Archives - OneSource Labs https://onesourcelabs.com/category/remote-testing/ Sample Studies Wed, 04 Jan 2023 18:59:41 +0000 en-US hourly 1 https://wordpress.org/?v=7.0.1 Improve Content Finding With Simple Card Sorting Exercises https://onesourcelabs.com/2017/06/06/improve-content-finding-with-simple-card-sorting-exercises/ Tue, 06 Jun 2017 17:28:06 +0000 http://www.onesourcelabs.com/?p=5550 “It’s not difficult to end up with a badly organized website, despite one’s best intentions. One of the most common reasons is that the Information Architecture (IA) is created from the business structure of the organization, rather than from users’ needs.” (Source: Smashing Magazine) The organization of the content on your website and how it [...]

The post Improve Content Finding With Simple Card Sorting Exercises appeared first on OneSource Labs.

]]>
“It’s not difficult to end up with a badly organized website, despite one’s best intentions. One of the most common reasons is that the Information Architecture (IA) is created from the business structure of the organization, rather than from users’ needs.” (Source: Smashing Magazine)

The organization of the content on your website and how it connects together – known as the Information Architecture (IA) – is an important part of a usable website. If the IA of a site is done well, users’ will rarely have problems finding what they need. How do you structure your site’s content in a way users will understand? One popular way is through a technique called card sorting.

Card Sorting is a tried and true technique for improving the IA of a site because it actually involves the users in the process, allowing them to communicate their organizational expectations and preferences.

We have conducted numerous card sorting exercises for clients across multiple industries to help inform structural redesign of their website content, navigation paths, menu structures, work flows, and product lists. Here are some of the most important things we’ve learned from our studies:

Keep It Simple
Users want logical and simple categories. For websites with extensive navigation menu items or product lists, utilize a multi-level categorization to avoid user confusion and frustration. Multi-level organization of content promotes an easier and quicker access to your content. This can be achieved by using larger and meaningful main categories and smaller and logical subcategories. Too many choices at the top-level can cause cognitive overload, while not enough can bury much needed information.

Card Sorting Resolves Internal Conflicts
If members of your team can’t seem to agree on the Information Architecture of your site, let card sorting come to the rescue. One of our clients had two teams who couldn’t agree on restructuring their website content. The card sorting exercises we ran helped resolve this conflict in the best way possible – the users told them exactly what they wanted.

Avoid Internal Language
Avoid using insider language or jargon that users don’t understand. A usable site should be easy for a user to learn and remember how to use, and if they don’t fully understand the language that’s being used, those goals will be more difficult to meet. The best way to find out whether you are using internal language for your labels, is to test them with actual users. Users are not shy in expressing “I have no idea what that means.” That’s when you know you are using internal language that’s not clear to your users. You can test unclear labels by including them in a follow-up survey study.

If your website is performing poorly, there may be any number of reasons for this, but poor Information Architecture might certainly be a main culprit because bad IA means users can’t find the content they’re after. Online card sorting is a preferred tool for helping to improve IA because it is reliable, inexpensive, easy to execute, and involves a large number of your site’s target users.

The post Improve Content Finding With Simple Card Sorting Exercises appeared first on OneSource Labs.

]]>
User Research & Agile: An Elegant Collaboration https://onesourcelabs.com/2017/05/15/user-research-agile-an-elegant-collaboration/ Mon, 15 May 2017 09:08:23 +0000 http://www.onesourcelabs.com/?p=5733 “Embedding user research evaluations in an agile software development process provides timely feedback from users and results in intensive collaboration between user research experts and software developers.” (Source: UX Matters) Advocates of user research are familiar with real benefits of testing an interface with the target audience: customer satisfaction, engagement and loyalty, which generally result [...]

The post User Research & Agile: An Elegant Collaboration appeared first on OneSource Labs.

]]>
“Embedding user research evaluations in an agile software development process provides timely feedback from users and results in intensive collaboration between user research experts and software developers.” (Source: UX Matters)

Advocates of user research are familiar with real benefits of testing an interface with the target audience: customer satisfaction, engagement and loyalty, which generally result in higher conversion rates and increased revenue. Including user research late into the design process can create certain challenges. In many cases, the changes are too costly to implement or it’s too late to implement them before launch. However, it is possible to include user research into an Agile framework harmoniously.

The ROI of User Research
The user research of a product needs to be factored in at early stages of the design process in order to achieve the maximum levels of return on investment. As the saying goes: Bad UX = money lost; Good UX = money gained. Indeed, maximum savings are gained from making changes earlier in the design life cycle.

The rule of thumb in many user-research-aware organizations is that the cost-benefit ratio for user research is $1 : $10-$100. In other words, once a system is in development, correcting a problem costs 10 times as much as fixing the same problem in design. If the system has been released, it costs 100 times as much relative to fixing in design. (Gilb, 1988)

What is Agile Development?
If you work in the tech industry, you’ve probably heard of Agile, and maybe you’ve even practiced it. For those who haven’t, Agile is a set of product development practices that favor responding to change rather than following a plan. The Agile framework operates in sprints that usually last one to two weeks at a time, allowing for several design iterations and changes. The agile process embraces change as a useful part of the process that actually pushes designers and developers in the right direction.

In addition to responding well to change, Agile development values individuals and interactions, customer collaboration, and products that work. There are several agile frameworks including Lean and Scrum.

The alternative framework to Agile is known as Waterfall, which is a process where time and cost are variables, but the scope of the project never changes. It’s an efficient way of getting a project done, but it doesn’t account for change very well, which can cause significant–and expensive–problems.

User Research Testing in an Agile Framework
Traditionally, when working within a Waterfall framework, user research is factored in close to the end of development. Because development is mostly completed at the point of testing, making any necessary changes found due to testing can be very costly. Additionally, there may not be enough time to incorporate the user research recommendations prior to launch.

“Agile offers many opportunities for overcoming problems with traditional development methods that have long impeded user research.” (Source: Nielsen Norman Group)

When working within an Agile framework, user research can be done from the early stages of the design and on a regular basis, meaning changes are easy to make and much less costly.

To overcome the challenges with conducting traditional user research in an Agile framework, you need to incorporate the following solutions:

  • Test small
  • Test during every sprint
  • Test any fidelity of the product
  • Add a feature/functionality to every test
  • Try different types of testing
  • Observe testing sessions with the entire team
  • Streamline the findings and recommendations report

Promoting Excellence with Agile and User Research
When user research is done during every sprint, it creates beneficial changes that improve the overall experience of a product because Agile methods inherently embrace and harness change, giving your product a competitive advantage.

Agile and user research go hand-in-hand because Agile principles call for good design and technical excellence, and User Research enforces excellence early on.

User Research is all about individuals and interactions while customer collaboration is an Agile value. User Research and Agile bring the user, team and business together on a regular basis. Iterative studies throughout the product life cycle can further inform the product’s Experience Design and result in task success and customer satisfaction.

The post User Research & Agile: An Elegant Collaboration appeared first on OneSource Labs.

]]>
Gather Significant Qualitative & Quantitative User Data with Online User Research Testing https://onesourcelabs.com/2017/03/26/gather-significant-qualitative-quantitative-user-data-with-online-user-research-testing/ Sun, 26 Mar 2017 17:14:49 +0000 http://www.onesourcelabs.com/?p=5542 “Research that happens in the participant’s natural environment can give you more realistic insights than lab research.” (Source: User Testing, Inc.) To fully comprehend users’ experience and satisfaction with a digital product, it is important to gather both quantitative and qualitative data. In the past, quantitative and qualitative testing had to be done separately due [...]

The post Gather Significant Qualitative & Quantitative User Data with Online User Research Testing appeared first on OneSource Labs.

]]>
“Research that happens in the participant’s natural environment can give you more realistic insights than lab research.” (Source: User Testing, Inc.)

To fully comprehend users’ experience and satisfaction with a digital product, it is important to gather both quantitative and qualitative data. In the past, quantitative and qualitative testing had to be done separately due to limitations of online testing tools and methodology. This inherently created timeline and budget constraints. For example, if you needed both types of data, performing two separate studies meant that you also needed two separate user groups. This was not only costly and took longer, but it also meant your data wasn’t coming from the same set of users.

Today’s industry leading online testing tools allow user research researchers to combine both quantitative and qualitative studies into one, while using the same user set, and consequently accommodating more efficient and cost effective results.

Some of the latest online user research tools are able to collect a comprehensive set of quantitative and qualitative data in a single study:

Behavioral/Qualitative Data

  • User comments and reasons why
  • User’s facial expressions
  • Clickstreams
  • Heatmaps
  • Screen recording

Quantitative Data

  • Task success or failure
  • Task effectiveness and efficiency
  • Task ease of use
  • User preferences
  • Survey responses
  • Satisfaction metrics
  • Net Promoter Scores
  • Information architecture data

What’s more, this data can be collected from hundreds of participants all over the globe, not just the 8-12 participants that one-on-one studies average. This will generate statistically significant results for your study.

Another benefit of online user research is the participants are taking the tests in their natural environment using their own devices, so their behaviors are natural – this is something that is almost impossible to recreate in a lab setting. And, because online testing can be automated (rather than just moderated), users are able to participate on their own schedule.

With automated testing, there are fewer logistics involved. There is no longer a need to set up test schedules, moderate individual test sessions, or recruit more users than necessary due to no-shows. All of this saves time and money. The majority of the effort is in configuring the online testing tool based on the user research research goals, monitoring the study while it’s live and analyzing the data collected by the tool. Online user research research facilitates frequent testing at lower costs at any stage of your product design cycle.

Many UX research experts agree that modern advancements with online user research allows us to perform more complete research that can capture the same qualitative data as in-lab tests, in addition to many other quantitative points of data. Because of this, unmoderated online user research is becoming more commonplace and more trusted. According to UX Matters, “Remote user research is a welcome addition to any researcher’s arsenal—particularly as we try to fit data collection into agile sprints and work within the constraints of an increasingly lean bottom line.”

The post Gather Significant Qualitative & Quantitative User Data with Online User Research Testing appeared first on OneSource Labs.

]]>
Improve Response Rates by Gamifying Your Online Surveys https://onesourcelabs.com/2017/02/07/improve-response-rates-by-gamifying-your-online-surveys/ Tue, 07 Feb 2017 18:24:55 +0000 http://www.onesourcelabs.com/?p=5501 Surveys, when done properly, can help a business gain real insight into their target audiences, rather than relying on guesses and assumptions. The gathering of this pertinent information can be used to create effective communication campaigns and marketing strategies, making it easier to meet set goals. Any business planning a survey push should first ask [...]

The post Improve Response Rates by Gamifying Your Online Surveys appeared first on OneSource Labs.

]]>
Surveys, when done properly, can help a business gain real insight into their target audiences, rather than relying on guesses and assumptions. The gathering of this pertinent information can be used to create effective communication campaigns and marketing strategies, making it easier to meet set goals. Any business planning a survey push should first ask themselves how to create an effective survey customers want to engage with.

Many online surveys, despite all efforts in creating optimal questions and targeting appropriate audiences, result in low response rates and high abandon rates.

“Response rates vary widely for different types of surveys. Customer satisfaction surveys and market research surveys often have response rates in the 10% – 30% range. Employee surveys typically have a response rate of 25% – 60%. Regardless of the type of survey you are conducting, you can have a major effect on the number of respondents who complete your survey.” (Source: PeoplePulse)

Here are some tips to improve engagement, enjoyment and interactivity with your online surveys. 

  • Limit the study duration to 10-15 minutes maximum
  • Include a progress bar to show how close respondents are to completion
  • Provide incentives (cash, gift card, product, discounts, badges, etc.)
  • Limit the number of open-ended questions to the most crucial subjects
  • Reword the questions in a way that makes respondents want to answer them (e.g. change: What is your favorite game? to: If you could only play one game for the rest of your life, what would it be?)
  • Include interactive elements whenever possible (e.g. images, graphics, videos, sounds, interactive sliders, star ratings, thumbs up/down, drag & drop, etc.)
  • Encourage Social Media sharing
  • Include photo breaks (e.g. provide visual breaks in between survey sections)

Additionally, online survey gamification can help increase survey response rates. Gamification of surveys not only encourages engagement with respondents, but it’s even been shown to increase the amount of time respondents spend per question, as well as increase response rates. Here are a few suggestion on how to gamify your next survey:

  • Turn demographic questions into a fill-in-the-blank story
  • Add an element of competition to your questions (e.g. list as many types of food as you can in 60 seconds)
  • Include a letter finding game (e.g. Ask respondents to find letters at various stages throughout the survey and unscramble at the end to reveal the answer.)
  • Include an Avatar (e.g. Ask respondents to choose an avatar to customize. The avatar will accompany them throughout the survey.)

A well-structured survey takes time and foresight. Knowing the kind of data you’re hoping to collect is helpful when writing questions. Having a general understanding of the audience who will receive the survey is also very important. According to SurveyGizmo, response rates can soar past 85% (about 43 responses for every 50 invitations sent) when the respondent population is motivated and the survey is well-executed. UX Mastery provides an in-depth look at how to craft a meaningful survey that works.

The post Improve Response Rates by Gamifying Your Online Surveys appeared first on OneSource Labs.

]]>
Promote Customer Engagement and Loyalty Through Effective Dashboard Design https://onesourcelabs.com/2017/01/16/promote-customer-engagement-and-loyalty-through-effective-dashboard-design/ Mon, 16 Jan 2017 17:50:25 +0000 http://www.onesourcelabs.com/?p=5489 "Any product that has an information dashboard as one of its key offerings should keep the psychological needs of its end users in mind." (Source: UX Magazine) A well-designed dashboard provides users quick access to their data on a regular basis. However, user research of dashboards is often overlooked during the design phase. In order [...]

The post Promote Customer Engagement and Loyalty Through Effective Dashboard Design appeared first on OneSource Labs.

]]>
“Any product that has an information dashboard as one of its key offerings should keep the psychological needs of its end users in mind.” (Source: UX Magazine)

A well-designed dashboard provides users quick access to their data on a regular basis. However, user research of dashboards is often overlooked during the design phase.

In order to promote user productivity, dashboard interfaces should be designed to provide quick access to crucial content in a clean, concise and intuitive fashion.

In a recent remote and moderated user research of a complex customer dashboard, real users of the product expressed their pain points in trying to find information they needed. Users expressed how it took them multiple clicks to get to a piece of data they needed on a daily basis. We found that difficulty in use of the existing dashboard had resulted in poor perception of a well-known product.

What Dashboard Users Really Want
The user research uncovered a considerable number of user research issues and resulted in a list of actionable recommendations to improve user research of the dashboard. We found that most users needed quick access to the same data on a daily basis. They wanted that information to be displayed using large font size on top of the page. We also found that users did not find it easy to look through a large amount of unorganized content to find what they needed.

Utilize an intuitive dashboard visual design to prominently display information that most users need regularly, no more or less.

Data Organization and Prioritization
Each dashboard is unique in terms of data and users. Once you have identified your dashboard target users’ needs, prioritize the top 3-5 pieces of information and prominently display them on top of the page. Use graphs, icons and color to differentiate each data. This will help users find what they need at a glance. It is important to display high-level information here. Details may be accessed by expanding each section or graph.

Alerts and notifications need to be given prominence on the face of the dashboard as well. Anything that requires immediate attention needs to be displayed within the user’s main visual field. Organize the rest of the content into meaningful categories and provide access to those from the dashboard. Always make sure your dashboard design is responsive as many users access it on the go.

Customization and Personalization
As user needs may be different based on their roles or preferences, allow for customization and personalization. In many cases, users have expressed an interest in customizing the information displayed and personalizing access to different sections of the site. A usable dashboard design is flexible enough to accommodate unique customer requirements.

Similar to any other interface, find out what your users need and design a dashboard that is usable across all platforms. As always, test regularly to improve user experience of your interfaces. This will result in customer satisfaction, engagement and loyalty.

When all is said and done, good dashboard design works to overcome the limitation of the user’s short-term memory. Read more about Short-Term Memory and Web User Research.

The post Promote Customer Engagement and Loyalty Through Effective Dashboard Design appeared first on OneSource Labs.

]]>
10 Things that Guarantee Success in a Remote and Moderated User Research Study https://onesourcelabs.com/2014/11/24/10-things-that-guarantee-success-in-a-remote-and-moderated-user-research-study/ Mon, 24 Nov 2014 13:31:46 +0000 http://www.onesourcelabs.com/?p=5244 Remote and moderated user research studies are becoming more popular as a cost-effective research approach when the site's target audience is spread out geographically (nationwide or international). However, remote user research studies by nature generate a few challenges that may easily be overcome by following a few simple techniques. Study Setup 1. Send detailed session setup instructions [...]

The post 10 Things that Guarantee Success in a Remote and Moderated User Research Study appeared first on OneSource Labs.

]]>
Remote and moderated user research studies are becoming more popular as a cost-effective research approach when the site’s target audience is spread out geographically (nationwide or international). However, remote user research studies by nature generate a few challenges that may easily be overcome by following a few simple techniques.

Study Setup

1. Send detailed session setup instructions
Prepare and email two sets of instructions for session setup prior to testing dates: one for the participants and the other for the observers.

2. Create individual sessions for each participant
Create unique session passwords and allocate at least 30-minute breaks in between sessions. This will prevent participants from logging into sessions other than their own.

3. Manage observer expectations in advance
As some observers may not have any prior experience with task-based user research studies (as opposed to focus groups), it is recommended to send a bulleted list of what to be expected in terms of remote and moderated task-based user research methodology and best practices (e.g. thinking out loud protocol, non-leading questions, non-encouraging tone of voice, etc.).

Session Setup

4. Plan for screen-sharing technical issues
Using a screen-sharing program for the first time might take longer than anticipated due to unexpected technical complications. Ask someone on your team to help you with calling participants 15-20 minutes prior to the start of each session and walk them through the installation process.

Always have a backup option for screen sharing. When all other attempts fail, you can email your participant the link to what you are testing and ask them to walk you through the tasks verbally as you follow their path using the mouse on your desktop for the observers’ viewing. In this case, you may need to ask additional clarification questions and be a little more expressive so your observers can get a better picture of what the participant is actually doing.

5. Minimize audio and video distractions
Use the conference call feature to mute entry/exit notifications. Remember to turn off any camera feed on your side. It is also recommended that participants do not use their webcam as it has shown to affect quality and speed of screen sharing, resulting in lags without adding much value.

Conducting Sessions

6. Include additional instructions
In addition to the standard instructions used for in-person user research studies, a couple of items need more emphasis for remote and moderated user research studies:

Emphasize to the participants the importance of using the mouse to point to objects on the screen that they are talking about. Also, do not hesitate to repeat this instruction throughout the session.

Ensure to communicate to your participants that you as the facilitator will be quiet most of the time during the study and will be taking notes of their comments.

7. Share the link to what you are testing during the session
Do not send a link to the website/prototype you are testing in advance. Rather, you may send the link to each participant within the screen-sharing program chat window right before you start with tasks. Doing this will prevent your participants from familiarizing themselves with the site prior to the user research session.

8. Maintain a fluid flow of conversation
As these studies are conducted remotely, the facilitator needs to maintain a more fluid flow of conversation compared to in-person studies. Based on experience, participants and observers feel uncomfortable with long pauses. Therefore, try to maintain a conversational flow by using transitional language from question to question and task to task.

9. Avoid unnecessary communication with observers
The facilitator should avoid any distraction during the user research sessions. Any communication with observers should be handled during the breaks in between sessions. Consider allocating a longer break after the first session to get in touch with observers and gather feedback.

Post Study

10. Preliminary Findings Recap
For those observers who are not in the same location as the facilitator, it is recommended to email a summarized list of high-level findings a couple of days after the study is completed.

A preliminary list of findings will facilitate agreement on the overall findings and will help manage expectations for the final report.

In conclusion, remote user research studies impose a few challenges, which are normally easier to control for in-person user research studies. The above-mentioned techniques can help minimize these challenges.

You can find more information on Remote User Research Tests by Nielsen Norman Group.

The post 10 Things that Guarantee Success in a Remote and Moderated User Research Study appeared first on OneSource Labs.

]]>
Product Perception Across Mobile App Platforms https://onesourcelabs.com/2014/10/21/product-perception-across-mobile-app-platforms/ Tue, 21 Oct 2014 13:33:45 +0000 http://www.onesourcelabs.com/?p=5246 With the development of different mobile platforms, it is imperative to consider the implications of ignoring a large segment of your target audience. Testing on different mobile platforms could result in higher customer satisfaction and net promoter scores. In a mobile app user research, it was found that standard gestures do not translate from one [...]

The post Product Perception Across Mobile App Platforms appeared first on OneSource Labs.

]]>
With the development of different mobile platforms, it is imperative to consider the implications of ignoring a large segment of your target audience.

Testing on different mobile platforms could result in higher customer satisfaction and net promoter scores.

In a mobile app user research, it was found that standard gestures do not translate from one platform to another for the same action. For example, the functions requiring a swiping gesture on an iOS, may require a tapping gesture on an Android.

The app that we tested utilized iOS gestures for a specific functionality on both iOS and Android platforms. The iOS users easily completed the task because they were accustomed to the swipe gesture for that functionality. However, many Android users were unable to complete the task because the swiping gesture for that functionality was not standard on Android. Therefore, many Android users failed to complete the main task.

The survey results revealed that some Android users were less satisfied with the product and less willing to download the app on their device. Most importantly, they were less likely to recommend the app to a friend or family member.

In conclusion, it is vital for a single app to be customized and tested for major platforms. Doing so will help to avoid compromising the user perception, experience, and satisfaction of the product.

The post Product Perception Across Mobile App Platforms appeared first on OneSource Labs.

]]>