User testing

Introduction

User testing helps us evaluate how easy a design is to use, and whether it meets the needs of its audience.

Recruitment

With 15 million members, it’s essential we recruit and test our products and services with the full spectrum of the population, including those who:

  • use assistive technologies
  • have cognitive difficulties
  • have motor impairments.

It’s vital that participants are part of your target audience and not recruited on their disability type alone. (For more on recruitment see this article on Research)

Timings

Testing is most beneficial at an early stage of a project, because it is likely to reveal issues we couldn’t have predicted and this gives us time to tackle them. However, the code needs to be sufficiently mature to test with users of assistive technology and motor impairments. As well as usability testing, you should factor in content testing with real content (created by a content designer) to gauge comprehension.

Testing should also take place at regular iterations in the design process.

Extra considerations

Including accessibility considerations in our testing should not substantially change or lengthen the process. However, you may need to factor in a little longer for:

  • planning
  • recruitment
  • the sessions themselves. In reality mistakes often take longer to recover from when using a screen reader.

Finally, it’s understandable to feel nervous about using the correct terminology with participants in a session, or not being hugely experienced with screen readers. Try to echo the language participants use, and make sure you do your homework on the technology and tools involved.

Things to check

Have you?

  • Recruited participants with a broad a range of access needs (e.g. visual, auditory, motor and cognitive)?
  • Considered using a survey to pre-qualify participants, if you’re intending to test different browsers and tools?
  • Asked users to either bring their own devices with their accessibility software setup, or made the software available in the lab setup?
  • Checked that the recording software you are using works with the participant’s assistive technology?
  • Allowed room for an extra person in the lab, for example the participant’s sign language interpreter or a carer?
  • Made sure all facilitators are familiar enough with technology that will be used by participants? For example, screen readers which tend to talk rapidly and can be hard to keep up with.
Did you find this page helpful?