Julia Wichlacz
2020
MC-Saar-Instruct: a Platform for Minecraft Instruction Giving Agents
Arne Köhn
|
Julia Wichlacz
|
Christine Schäfer
|
Álvaro Torralba
|
Joerg Hoffmann
|
Alexander Koller
Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue
We present a comprehensive platform to run human-computer experiments where an agent instructs a human in Minecraft, a 3D blocksworld environment. This platform enables comparisons between different agents by matching users to agents. It performs extensive logging and takes care of all boilerplate, allowing to easily incorporate new agents to evaluate them. Our environment is prepared to evaluate any kind of instruction giving system, recording the interaction and all actions of the user. We provide example architects, a Wizard-of-Oz architect and set-up scripts to automatically download, build and start the platform.
Generating Instructions at Different Levels of Abstraction
Arne Köhn
|
Julia Wichlacz
|
Álvaro Torralba
|
Daniel Höller
|
Jörg Hoffmann
|
Alexander Koller
Proceedings of the 28th International Conference on Computational Linguistics
When generating technical instructions, it is often convenient to describe complex objects in the world at different levels of abstraction. A novice user might need an object explained piece by piece, while for an expert, talking about the complex object (e.g. a wall or railing) directly may be more succinct and efficient. We show how to generate building instructions at different levels of abstraction in Minecraft. We introduce the use of hierarchical planning to this end, a method from AI planning which can capture the structure of complex objects neatly. A crowdsourcing evaluation shows that the choice of abstraction level matters to users, and that an abstraction strategy which balances low-level and high-level object descriptions compares favorably to ones which don’t.
Search
Co-authors
- Arne Köhn 2
- Álvaro Torralba 2
- Alexander Koller 2
- Christine Schäfer 1
- Joerg Hoffmann 1
- show all...