UZH-Logo

Evaluating the effectiveness of interactive map interface designs: a case study integrating usability metrics with eye-movement analysis


Coltekin, Arzu; Heil, B; Garlandini, S; Fabrikant, Sara I (2009). Evaluating the effectiveness of interactive map interface designs: a case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36(1):5-17.

Abstract

This paper proposes combining traditional usability methods with the analysis of eye movement recordings to evaluate interactive map interfaces, and presents a case study in support of this approach. The case study evaluates two informationally equivalent, but differently designed online interactive map interfaces presented to novice users. In a mixed factorial experiment, thirty participants were asked to solve three typical map-use tasks using one of the two interfaces; we then measured user satisfaction, efficiency (completion time) and effectiveness (accuracy) with standard SEE usability metrics. While traditional (bottom line) usability metrics can reveal a range of usability problems, they may be enhanced by additional procedural measures such as eye movement recordings. Eye movements have been shown to help reveal the amount of cognitive processing a display requires and where these cognitive resources are required. Therefore, we can establish how a display may or may not facilitate task completion by analyzing eye movement recordings. User satisfaction information related to tested stimuli (i.e., collected through standardized questionnaires) can also be linked to eye tracking data for further analysis. We hope that the presented methodology and case study will help cartographers and map interface designers to better identify design issues in their products, and that these insights will eventually lead to more effective and efficient online map interfaces.

This paper proposes combining traditional usability methods with the analysis of eye movement recordings to evaluate interactive map interfaces, and presents a case study in support of this approach. The case study evaluates two informationally equivalent, but differently designed online interactive map interfaces presented to novice users. In a mixed factorial experiment, thirty participants were asked to solve three typical map-use tasks using one of the two interfaces; we then measured user satisfaction, efficiency (completion time) and effectiveness (accuracy) with standard SEE usability metrics. While traditional (bottom line) usability metrics can reveal a range of usability problems, they may be enhanced by additional procedural measures such as eye movement recordings. Eye movements have been shown to help reveal the amount of cognitive processing a display requires and where these cognitive resources are required. Therefore, we can establish how a display may or may not facilitate task completion by analyzing eye movement recordings. User satisfaction information related to tested stimuli (i.e., collected through standardized questionnaires) can also be linked to eye tracking data for further analysis. We hope that the presented methodology and case study will help cartographers and map interface designers to better identify design issues in their products, and that these insights will eventually lead to more effective and efficient online map interfaces.

Citations

39 citations in Web of Science®
66 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

3 downloads since deposited on 16 Jan 2010
0 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:07 Faculty of Science > Institute of Geography
Dewey Decimal Classification:910 Geography & travel
Language:English
Date:2009
Deposited On:16 Jan 2010 21:13
Last Modified:05 Apr 2016 13:45
Publisher:American Congress on Surveying and Mapping
ISSN:1523-0406
Publisher DOI:10.1559/152304009787340197
Permanent URL: http://doi.org/10.5167/uzh-27556

Download

[img]
Filetype: PDF - Registered users only
Size: 1MB
View at publisher

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations