2020
pdf
bib
abs
Generating Medical Reports from Patient-Doctor Conversations Using Sequence-to-Sequence Models
Seppo Enarvi
|
Marilisa Amoia
|
Miguel Del-Agua Teba
|
Brian Delaney
|
Frank Diehl
|
Stefan Hahn
|
Kristina Harris
|
Liam McGrath
|
Yue Pan
|
Joel Pinto
|
Luca Rubini
|
Miguel Ruiz
|
Gagandeep Singh
|
Fabian Stemmer
|
Weiyi Sun
|
Paul Vozila
|
Thomas Lin
|
Ranjani Ramamurthy
Proceedings of the First Workshop on Natural Language Processing for Medical Conversations
We discuss automatic creation of medical reports from ASR-generated patient-doctor conversational transcripts using an end-to-end neural summarization approach. We explore both recurrent neural network (RNN) and Transformer-based sequence-to-sequence architectures for summarizing medical conversations. We have incorporated enhancements to these architectures, such as the pointer-generator network that facilitates copying parts of the conversations to the reports, and a hierarchical RNN encoder that makes RNN training three times faster with long inputs. A comparison of the relative improvements from the different model architectures over an oracle extractive baseline is provided on a dataset of 800k orthopedic encounters. Consistent with observations in literature for machine translation and related tasks, we find the Transformer models outperform RNN in accuracy, while taking less than half the time to train. Significantly large wins over a strong oracle baseline indicate that sequence-to-sequence modeling is a promising approach for automatic generation of medical reports, in the presence of data at scale.
2018
pdf
bib
abs
Scalable Wide and Deep Learning for Computer Assisted Coding
Marilisa Amoia
|
Frank Diehl
|
Jesus Gimenez
|
Joel Pinto
|
Raphael Schumann
|
Fabian Stemmer
|
Paul Vozila
|
Yi Zhang
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers)
In recent years the use of electronic medical records has accelerated resulting in large volumes of medical data when a patient visits a healthcare facility. As a first step towards reimbursement healthcare institutions need to associate ICD-10 billing codes to these documents. This is done by trained clinical coders who may use a computer assisted solution for shortlisting of codes. In this work, we present our work to build a machine learning based scalable system for predicting ICD-10 codes from electronic medical records. We address data imbalance issues by implementing two system architectures using convolutional neural networks and logistic regression models. We illustrate the pros and cons of those system designs and show that the best performance can be achieved by leveraging the advantages of both using a system combination approach.
2013
pdf
bib
Using Comparable Collections of Historical Texts for Building a Diachronic Dictionary for Spelling Normalization
Marilisa Amoia
|
Jose Manuel Martinez
Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
2012
pdf
bib
SB: mmSystem - Using Decompositional Semantics for Lexical Simplification
Marilisa Amoia
|
Massimo Romanelli
*SEM 2012: The First Joint Conference on Lexical and Computational Semantics – Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (SemEval 2012)
pdf
bib
abs
Coreference in Spoken vs. Written Texts: a Corpus-based Analysis
Marilisa Amoia
|
Kerstin Kunz
|
Ekaterina Lapshinova-Koltunski
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
This paper describes an empirical study of coreference in spoken vs. written text. We focus on the comparison of two particular text types, interviews and popular science texts, as instances of spoken and written texts since they display quite different discourse structures. We believe in fact, that the correlation of difficulties in coreference resolution and varying discourse structures requires a deeper analysis that accounts for the diversity of coreference strategies or their sub-phenomena as indicators of text type or genre. In this work, we therefore aim at defining specific parameters that classify differences in genres of spoken and written texts such as the preferred segmentation strategy, the maximal allowed distance in or the length and size of coreference chains as well as the correlation of structural and syntactic features of coreferring expressions. We argue that a characterization of such genre dependent parameters might improve the performance of current state-of-art coreference resolution technology.
2011
pdf
bib
Discontinuous Constituents: a Problematic Case for Parallel Corpora Annotation and Querying
Marilisa Amoia
|
Kerstin Kunz
|
Ekaterina Lapshinova-Koltunski
Proceedings of the Second Workshop on Annotation and Exploitation of Parallel Corpora
2008
pdf
bib
abs
A Test Suite for Inference Involving Adjectives
Marilisa Amoia
|
Claire Gardent
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
Recently, most of the research in NLP has concentrated on the creation of applications coping with textual entailment. However, there still exist very few resources for the evaluation of such applications. We argue that the reason for this resides not only in the novelty of the research field but also and mainly in the difficulty of defining the linguistic phenomena which are responsible for inference. As the TSNLP project has shown test suites provide optimal diagnostic and evaluation tools for NLP applications, as contrary to text corpora they provide a deep insight in the linguistic phenomena allowing control over the data. Thus in this paper, we present a test suite specifically developed for studying inference problems shown by English adjectives. The construction of the test suite is based on the deep linguistic analysis and following classification of entailment patterns of adjectives and follows the TSNLP guidelines on linguistic databases providing a clear coverage, systematic annotation of inference tasks, large reusability and simple maintenance. With the design of this test suite we aim at creating a resource supporting the evaluation of computational systems handling natural language inference and in particular at providing a benchmark against which to evaluate and compare existing semantic analysers.
2007
pdf
bib
A first order semantic approach to adjectival inference
Marilisa Amoia
|
Claire Gardent
Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing
2006
pdf
bib
Adjective based inference
Marilisa Amoia
|
Claire Gardent
Proceedings of the Workshop KRAQ’06: Knowledge and Reasoning for Language Processing
2004
pdf
bib
Paraphrastic grammars
Claire Gardent
|
Marilisa Amoia
|
Evelyne Jacquey
Proceedings of the 2nd Workshop on Text Meaning and Interpretation