Cohen Courses:Dmovshov abbreviations

Course Page

Identifying Abbreviations in Biomedical Text

Idea

Abbreviations, synonyms and acronyms are heavily used in biomedical literature, for describing names of genes, diseases, biological processes and more. Recognizing short or alternative name forms and mapping them to the full (long) form is important to the full understanding of scientific text. In the context of information extraction tasks, recognizing abbreviated forms can lead to a great increase in recall. This task is especially challenging since abbreviations are often reused, for example, names of genes and systems are shared across species, and since researchers often do not adhere to standard naming conventions. In this project we wish to provide a model for linking an abbreviated or short form biomedical terms to full terms as well as recognize abbreviations that may relate to more than a single entity.

The current baseline by Schwartz and Hearst provides a way of extracting abbreviation pairs that are mentioned in close proximity in text. The goal of this project is to provide a more robust extraction model, as well as provide a model that can estimate the likelihood of a pair of short and long form mentions being an abbreviation pair. This type of model can be used for evaluating abbreviation pairs even when they are not mentioned in close proximity in a document, and with this model we can select the most likely pair when given several probably options.

Approach

The abbreviation extraction process is done in two steps:

1. Recognize candidate <short-form, long-form> pairs from text.
2. Extract possible long-form versions for each of the abbreviated short-forms.

In this project I will try to improve both the recognition and extraction steps. The main emphasis will be on developing an extraction model. Given a candidate long form and short form pair, the model will provide the most likely alignment of the two, attempting to match (align) short form letters to their long form equivalent positions. I will use some type of sequential model, with one of the main considerations being that in some cases it is desirable for the model to relate to an entire word but in others it is better to relate to a single letter/symbol at a time.

Team

Dana Movshovitz-Attias

Data

Abbreviations Dataset

MEDSTRACT is a collection of automatically extracted acronym pairs from MEDLINE databases. The data includes:

• Gold Standard Data: 400 abstracts including abbreviations.
• I wasn't able to find the gold standard labeling of abbreviation pairs so I annotated the data myself. The annotation includes pairs of <abbreviation, full form name> that appear in each abstract.

Corpus

Full length documents taken from:

• PubMed Central open access archive documents

So far found no data for long-forms of abbreviations in full documents - may have to manually label some. Alternatively, can use the MEDSTRACT gold standard list as a "complete" list of known abbreviations and ignore all others in the corpus.

Baseline

A simple algorithm for identifying abbreviation definitions in biomedical text by A. S. Schwartz and M. A. Hearst

I implemented the baseline method and tested it on the Medstract dataset.

Results on Medstract Data

• Precision: 88%
• Recall: 87%
• F1: 87%

Related Work

Recognizing abbreviations

• Baseline method: A simple algorithm for identifying abbreviation definitions in biomedical text by A. S. Schwartz and M. A. Hearst
• Hybrid text mining for finding abbreviations and their definitions by Youngja Park and Roy J. Byrd
• An Automatic Identification and Resolution System for Protein-Related Abbreviations in Scientific Papers by Paolo Atzeni, Fabio Polticelli and Daniele Toti
• Mapping Abbreviations to Full Forms in Biomedical Articles by Hong Yu, George Hripcsak and Carol Friedman

String alignment

• "Learning String Edit Distance" by Ristad and Yianilos, 1997
• "Adaptive duplicate detection using learnable string similarity measures" by Bilenko and Mooney, ACM SIGKDD, 2003
• Bellare and Pereira - "A CRF for discriminatively-trained finite-state string edit distance"

Comments from William

Nice to see this coming along! --Wcohen 20:53, 22 September 2011 (UTC)

More Comments from William

Nice to see the baseline results already here! --Wcohen 14:38, 11 October 2011 (UTC)