Using usability testing to assess web accessibility
Year: 2023
Type: article
Abstract: Web accessibility is a fundamental condition for an inclusive society and is, eventually, beneficial for every user. In order to measure web accessibility, different tools and methods have been developed and adopted. However, web accessibility is still often seen as a mere adherence to standards, e.g., the Web Content Accessibility Guidelines (WCAG). We claim that only actual users with disabilities themselves can conclusively evaluate whether a website is accessible. Thus, WCAG testing must be complemented with usability testing. In recent research we built upon prior WCAG testing results to conduct a usability test to assess the accessibility of our university’s website. We invited 12 users with various degrees of visual impairments to come to our usability lab and bring their own devices to test our website. This unconventional usability test, together with extensive pre- and post-task interviews brought various accessibility problems to light, many of which were not noticed in the WCAG testing. Aside from the actual test results this project delivered us new insights on how to apply UX methods, such as usability testing, to assess web accessibility. The old UX mantra "you are not the user" is even more true when extended to the field of accessibility. Testing with actual users is key, but it has some caveats we did not anticipate beforehand. In sharing our experiences, we want to encourage the UX community to consider working together with users with disabilities and adopting the two-level approach (adherence to standards and usability testing) when assessing web accessibility.
Authors: Fuhrmann, Birgit, Schuler, Martin
Language: English
Subfield: Human Factors and Ergonomics
Field: Social Sciences
Domain: Social Sciences
SDG: Reduced inequalities
Open Access status: green
OpenAlex ID: W7072315240
