The CLAMS Platform at Work: Processing Audiovisual Data from the American Archive of Public Broadcasting

Marc Verhagen, Kelley Lynch, Kyeongmin Rim, James Pustejovsky


Abstract
The Computational Linguistics Applications for Multimedia Services (CLAMS) platform provides access to computational content analysis tools for multimedia material. The version we present here is a robust update of an initial prototype implementation from 2019. The platform now sports a variety of image, video, audio and text processing tools that interact via a common multi-modal representation language named MMIF (Multi-Media Interchange Format). We describe the overall architecture, the MMIF format, some of the tools included in the platform, the process to set up and run a workflow, visualizations included in CLAMS, and evaluate aspects of the platform on data from the American Archive of Public Broadcasting, showing how CLAMS can add metadata to mass-digitized multimedia collections, metadata that are typically only available implicitly in now largely unsearchable digitized media in archives and libraries.
Anthology ID:
2022.lrec-1.266
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
2498–2506
Language:
URL:
https://aclanthology.org/2022.lrec-1.266
DOI:
Bibkey:
Cite (ACL):
Marc Verhagen, Kelley Lynch, Kyeongmin Rim, and James Pustejovsky. 2022. The CLAMS Platform at Work: Processing Audiovisual Data from the American Archive of Public Broadcasting. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 2498–2506, Marseille, France. European Language Resources Association.
Cite (Informal):
The CLAMS Platform at Work: Processing Audiovisual Data from the American Archive of Public Broadcasting (Verhagen et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.266.pdf