Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment

Masayasu Muraoka, Tetsuya Nasukawa, Bishwaranjan Bhattacharjee


Abstract
We propose a new word representation method derived from visual objects in associated images to tackle the lexical entailment task. Although it has been shown that the Distributional Informativeness Hypothesis (DIH) holds on text, in which the DIH assumes that a context surrounding a hyponym is more informative than that of a hypernym, it has never been tested on visual objects. Since our perception is tightly associated with language, it is meaningful to explore whether the DIH holds on visual objects. To this end, we consider visual objects as the context of a word and represent a word as a bag of visual objects found in images associated with the word. This allows us to test the feasibility of the visual DIH. To better distinguish word pairs in a hypernym relation from other relations such as co-hypernyms, we also propose a new measurable function that takes into account both the difference in the generality of meaning and similarity of meaning between words. Our experimental results show that the DIH holds on visual objects and that the proposed method combined with the proposed function outperforms existing unsupervised representation methods.
Anthology ID:
2020.findings-emnlp.246
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2723–2735
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.246
DOI:
10.18653/v1/2020.findings-emnlp.246
Bibkey:
Cite (ACL):
Masayasu Muraoka, Tetsuya Nasukawa, and Bishwaranjan Bhattacharjee. 2020. Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2723–2735, Online. Association for Computational Linguistics.
Cite (Informal):
Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment (Muraoka et al., Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.246.pdf
Video:
 https://slideslive.com/38940172
Data
HyperLex