Multi-Agent Language Learning: Symbolic Mapping

Yicheng Feng, Zongqing Lu


Abstract
The study of emergent communication has long been devoted to coax neural network agents to learn a language sharing similar properties with human language. In this paper, we try to find a ‘natural’ way to help agents learn a compositional and symmetric language in complex settings like dialog games. Inspired by the theory that human language was originated from simple interactions, we hypothesize that language may evolve from simple tasks to difficult tasks. We propose a curriculum learning method called task transfer, and propose a novel architecture called symbolic mapping. We find that task transfer distinctly helps language learning in difficult tasks, and symbolic mapping promotes the effect. Further, we explore vocabulary expansion, and show that with the help of symbolic mapping, agents can easily learn to use new symbols when the environment becomes more complex. All in all, we find that a process from simplicity to complexity can serve as a natural way to help multi-agent language learning, and the proposed symbolic mapping is effective for this process.
Anthology ID:
2023.findings-acl.491
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7756–7770
Language:
URL:
https://aclanthology.org/2023.findings-acl.491
DOI:
10.18653/v1/2023.findings-acl.491
Bibkey:
Cite (ACL):
Yicheng Feng and Zongqing Lu. 2023. Multi-Agent Language Learning: Symbolic Mapping. In Findings of the Association for Computational Linguistics: ACL 2023, pages 7756–7770, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Multi-Agent Language Learning: Symbolic Mapping (Feng & Lu, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.491.pdf