Examining field usability testing outcomes conducted on virtual and physical mobile devices using wearable eye tracking

Abstract

There is a growing need to conduct usability testing with smartphones and tablets as adoption of these devices continues to increase. Virtual device testing is a popular approach due to the diversity of devices and operating systems available to users in the mobile market; however, this approach can distance the results from real-world applications. Using a wearable eye tracker, this study compares how the use of a desktop emulator or physical device influences usability testing in a field environment. Results suggest that when compared to a virtual device (emulator), the use of a physical device has an influence on both time on task and perceived usability. Analysis of eye tracking measures identified differences in the amount of time that attention was given to specific areas on-screen and off-screen, indicating that using an actual device rather than a virtual device can also influence attention.