Introduction and Material
Web-based tests are an established method for the evaluation (e.g. [1]). However, the validity of web-experiments has not yet been evaluated for the field of embodied conversation agents (ECAs). In this paper, evaluation results obtained in a non-interactive scenario in our lab [2] are compared to a similar web-based experiment. 3 different talking head components and 2 freely available speech synthesis systems (TTS) are combined. The head components used are the thinking head (TH), Massy (MS), and a speaker cloning system (CL). The TTS include Mary (‘hmm-bits3’) and Mbrola (’de2’). We recorded videos of the talking heads speaking sentences related to the smart home domain like: The following devices can be turned on or off: the TV, the lamps and the fan.’
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Koda, T., Ishida, T.: Cross-cultural study of avatar expression interpretation. In: International Symposium on Applications and the Internet, SAINT 2006 (2006)
Kühnel, C., Weiss, B., Wechsung, I., Fagel, S., Möller, S.: Evaluating talking heads for smart home systems. In: Proc. International Conference on Multimodal Interfaces (ICMI) (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Weiss, B., Kühnel, C., Wechsung, I., Möller, S., Fagel, S. (2009). Web-Based Evaluation of Talking Heads: How Valid Is It?. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds) Intelligent Virtual Agents. IVA 2009. Lecture Notes in Computer Science(), vol 5773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04380-2_87
Download citation
DOI: https://doi.org/10.1007/978-3-642-04380-2_87
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04379-6
Online ISBN: 978-3-642-04380-2
eBook Packages: Computer ScienceComputer Science (R0)