Zhi Zhong


2024

pdf bib
On the Language Encoder of Contrastive Cross-modal Models
Mengjie Zhao | Junya Ono | Zhi Zhong | Chieh-Hsin Lai | Yuhta Takida | Naoki Murata | Wei-Hsiang Liao | Takashi Shibuya | Hiromi Wakaki | Yuki Mitsufuji
Findings of the Association for Computational Linguistics: ACL 2024

Contrastive cross-modal models such as CLIP and CLAP aid various vision-language (VL) and audio-language (AL) tasks. However, there has been limited investigation of and improvement in their language encoder – the central component of encoding natural language descriptions of image/audio into vector representations. We extensively evaluate how unsupervised and supervised sentence embedding training affect language encoder quality and cross-modal task performance. In VL pretraining, we found that sentence embedding training enhances language encoder quality and aids in cross-modal tasks, improving contrastive VL models such as CyCLIP. Sentence embedding training benefits AL tasks when the amount of training data is large. We analyze the representation spaces to understand the strengths of sentence embedding training, and find that it improves text-space uniformity, at the cost of decreased cross-modal alignment.

2013

pdf bib
Towards Robust Linguistic Analysis using OntoNotes
Sameer Pradhan | Alessandro Moschitti | Nianwen Xue | Hwee Tou Ng | Anders Björkelund | Olga Uryupina | Yuchen Zhang | Zhi Zhong
Proceedings of the Seventeenth Conference on Computational Natural Language Learning

2012

pdf bib
Word Sense Disambiguation Improves Information Retrieval
Zhi Zhong | Hwee Tou Ng
Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

2010

pdf bib
It Makes Sense: A Wide-Coverage Word Sense Disambiguation System for Free Text
Zhi Zhong | Hwee Tou Ng
Proceedings of the ACL 2010 System Demonstrations

2008

pdf bib
Word Sense Disambiguation Using OntoNotes: An Empirical Study
Zhi Zhong | Hwee Tou Ng | Yee Seng Chan
Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing

2007

pdf bib
NUS-PT: Exploiting Parallel Texts for Word Sense Disambiguation in the English All-Words Tasks
Yee Seng Chan | Hwee Tou Ng | Zhi Zhong
Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval-2007)