Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance

This chapter is based on a research conducted that involves usability testing on websites performed on a target audience that are multilingual (English, Malay, Mandarin and Tamil). If a study is carried out without an eye tracker, the moderator has to rely on the think-aloud (TA) feedback and the no...

Full description

Main Authors: Sivaji, A., Wan Ahmad, W.F.
Format: Book
Institution: Universiti Teknologi Petronas
Record Id / ISBN-0: utp-eprints.31825 /
Published: Springer International Publishing 2014
Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-84921743882&doi=10.1007%2f978-3-319-02868-2_21&partnerID=40&md5=66a5ec3ace566ba021b3edb6fbf7e153
http://eprints.utp.edu.my/31825/
Tags: Add Tag
No Tags, Be the first to tag this record!
id utp-eprints.31825
recordtype eprints
spelling utp-eprints.318252022-03-29T03:30:11Z Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance Sivaji, A. Wan Ahmad, W.F. This chapter is based on a research conducted that involves usability testing on websites performed on a target audience that are multilingual (English, Malay, Mandarin and Tamil). If a study is carried out without an eye tracker, the moderator has to rely on the think-aloud (TA) feedback and the notes captured by the usability analyst. Moreover, it has been found that using TA technique alone may not be suitable and reliable in usability studies in Malaysia whereby there exists high power distance (Hofstede�s model). With the eye tracker, the usability practitioner can now complement the TA feedback with one of the human biometric feature, which in this case is the user�s eye. This increases the data integrity obtained from all users. Using a combination of visualisation and analysis tools from the Tobii Studio such as cluster plot and gaze data, areas of high concentration in a web interface could be revealed. Based on the marked areas of interest (AOI), descriptive statistics such as fixation count, fixation duration, time to first fixation and mouse click-related data were used to correlate with the data obtained from the TA protocol. For instance, the consistent results from the TA and eye tracking enabled the moderator to conclude that one website had more efficient navigation strategy than other. There was a significant correlation and consistency between the TA feedback and the eye-tracking analysis. This enabled the usability analyst to present the findings with visual, audio and statistical evidence, eventually increasing the persuasive power towards the design and development team to implement changes. The findings of this study challenges the recruitment criteria spelt out in user experience (UX) studies today which limits the subjects to the language of the website being tested. © Springer International Publishing Switzerland 2014. Springer International Publishing 2014 Book NonPeerReviewed https://www.scopus.com/inward/record.uri?eid=2-s2.0-84921743882&doi=10.1007%2f978-3-319-02868-2_21&partnerID=40&md5=66a5ec3ace566ba021b3edb6fbf7e153 Sivaji, A. and Wan Ahmad, W.F. (2014) Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance. Springer International Publishing, pp. 267-278. http://eprints.utp.edu.my/31825/
institution Universiti Teknologi Petronas
collection UTP Institutional Repository
description This chapter is based on a research conducted that involves usability testing on websites performed on a target audience that are multilingual (English, Malay, Mandarin and Tamil). If a study is carried out without an eye tracker, the moderator has to rely on the think-aloud (TA) feedback and the notes captured by the usability analyst. Moreover, it has been found that using TA technique alone may not be suitable and reliable in usability studies in Malaysia whereby there exists high power distance (Hofstede�s model). With the eye tracker, the usability practitioner can now complement the TA feedback with one of the human biometric feature, which in this case is the user�s eye. This increases the data integrity obtained from all users. Using a combination of visualisation and analysis tools from the Tobii Studio such as cluster plot and gaze data, areas of high concentration in a web interface could be revealed. Based on the marked areas of interest (AOI), descriptive statistics such as fixation count, fixation duration, time to first fixation and mouse click-related data were used to correlate with the data obtained from the TA protocol. For instance, the consistent results from the TA and eye tracking enabled the moderator to conclude that one website had more efficient navigation strategy than other. There was a significant correlation and consistency between the TA feedback and the eye-tracking analysis. This enabled the usability analyst to present the findings with visual, audio and statistical evidence, eventually increasing the persuasive power towards the design and development team to implement changes. The findings of this study challenges the recruitment criteria spelt out in user experience (UX) studies today which limits the subjects to the language of the website being tested. © Springer International Publishing Switzerland 2014.
format Book
author Sivaji, A.
Wan Ahmad, W.F.
spellingShingle Sivaji, A.
Wan Ahmad, W.F.
Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
author_sort Sivaji, A.
title Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
title_short Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
title_full Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
title_fullStr Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
title_full_unstemmed Benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
title_sort benefits of complementing eye-tracking analysis with think-aloud protocol in a multilingual country with high power distance
publisher Springer International Publishing
publishDate 2014
url https://www.scopus.com/inward/record.uri?eid=2-s2.0-84921743882&doi=10.1007%2f978-3-319-02868-2_21&partnerID=40&md5=66a5ec3ace566ba021b3edb6fbf7e153
http://eprints.utp.edu.my/31825/
_version_ 1741197642780639232
score 11.62408