Scikit-talk: A toolkit for processing real-world conversational speech data

Andreas Liesenfeld, Gabor Parti, Chu-Ren Huang


Abstract
We present Scikit-talk, an open-source toolkit for processing collections of real-world conversational speech in Python. First of its kind, the toolkit equips those interested in studying or modeling conversations with an easy-to-use interface to build and explore large collections of transcriptions and annotations of talk-in-interaction. Designed for applications in speech processing and Conversational AI, Scikit-talk provides tools to custom-build datasets for tasks such as intent prototyping, dialog flow testing, and conversation design. Its preprocessor module comes with several pre-built interfaces for common transcription formats, which aim to make working across multiple data sources more accessible. The explorer module provides a collection of tools to explore and analyse this data type via string matching and unsupervised machine learning techniques. Scikit-talk serves as a platform to collect and connect different transcription formats and representations of talk, enabling the user to quickly build multilingual datasets of varying detail and granularity. Thus, the toolkit aims to make working with authentic conversational speech data in Python more accessible and to provide the user with comprehensive options to work with representations of talk in appropriate detail for any downstream task. For the latest updates and information on currently supported languages and language resources, please refer to: https://pypi.org/project/scikit-talk/
Anthology ID:
2021.sigdial-1.26
Volume:
Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
July
Year:
2021
Address:
Singapore and Online
Editors:
Haizhou Li, Gina-Anne Levow, Zhou Yu, Chitralekha Gupta, Berrak Sisman, Siqi Cai, David Vandyke, Nina Dethlefs, Yan Wu, Junyi Jessy Li
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
252–256
Language:
URL:
https://aclanthology.org/2021.sigdial-1.26
DOI:
10.18653/v1/2021.sigdial-1.26
Bibkey:
Cite (ACL):
Andreas Liesenfeld, Gabor Parti, and Chu-Ren Huang. 2021. Scikit-talk: A toolkit for processing real-world conversational speech data. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 252–256, Singapore and Online. Association for Computational Linguistics.
Cite (Informal):
Scikit-talk: A toolkit for processing real-world conversational speech data (Liesenfeld et al., SIGDIAL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.sigdial-1.26.pdf
Video:
 https://www.youtube.com/watch?v=yNtYLKCo3xI