Voice versus keyboard and mouse for text creation on Arabic user interfaces

Abstract EN

Voice User Interfaces (VUIs) are increasingly popular owing to improvements in automatic speech recognition.

However, the understanding of user interaction with VUIs, particularly Arabic VUIs, remains limited.

Hence, this research compared user performance, learnability, and satisfaction when using voice and keyboard-and-mouse input modalities for text creation on Arabic user interfaces.

A Voice-enabled Email Interface (VEI) and a Traditional Email Interface (TEI) were developed.

Forty participants attempted pre-prepared and self-generated message creation tasks using voice on the VEI, and the keyboard-and-mouse modal on the TEI.

The results showed that participants were faster (by 1.76 to 2.67 minutes) in pre-prepared message creation using voice than using the keyboard and mouse.

Participants were also faster (by 1.72 to 2.49 minutes) in self-generated message creation using voice than using the keyboard and mouse.

Although the learning curves were more efficient with the VEI, more participants were satisfied with the TEI.

With the VEI, participants reported problems, such as misrecognitions and misspellings, but were satisfied about the visibility of possible executable commands and about the overall accuracy of voice recognition.