Miroslav Melichar
2006
Archivus: A Multimodal System for Multimedia Meeting Browsing and Retrieval
Marita Ailomaa
|
Miroslav Melichar
|
Agnes Lisowska
|
Martin Rajman
|
Susan Armstrong
Proceedings of the COLING/ACL 2006 Interactive Presentation Sessions
Extending the Wizard of Oz Methodologie for Multimodal Language-enabled Systems
Martin Rajman
|
Marita Ailomaa
|
Agnes Lisowska
|
Miroslav Melichar
|
Susan Armstrong
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)
In this paper we present a proposal for extending the standard Wizard of Oz experimental methodology to language-enabled multimodal systems. We first discuss how Wizard of Oz experiments involving multimodal systems differ from those involving voice-only systems. We then go on to discuss the Extended Wizard of Oz methodology and the Wizard of Oz testing environment and protocol that we have developed. We then describe an example of applying this methodology to Archivus, a multimodal system for multimedia meeting retrieval and browsing. We focus in particular on the tools that the wizards would need to successfully and efficiently perform their tasks in a multimodal context. We conclude with some general comments about which questions need to be addressed when developing and using the Wizard of Oz methodology for testing multimodal systems.
Search