A Barrier Walkthrough Study with Expert and Non-Expert Judges

Abstract

This report presents a Barrier Walkthrough (BW) study that has been conducted with 19 expert and 57 non-expert judges. This study aims to investigate two overarching research questions: 1. What are the common barrier types between mobile and disabled web users? 2. What is the role of expertise on the BW method? This report first presents the methodology used in detail and then presents the major findings of this study. In brief, this study shows that there are a significant number of common barrier types between mobile and disabled users. It also shows that expertise matter and even though the effect of expertise varies depending on the quality attribute, the level of expertise is still an important factor in the quality of accessibility evaluation of web pages, and therefore that it should be considered when interpreting evaluation reports. This study also shows some limitations of the BW method which can be improved.