ICBO_2018_18: Taking a Dive: Experiments in Deep Learning for Automatic Ontology-based Annotation of Scientific Literature

TitleICBO_2018_18: Taking a Dive: Experiments in Deep Learning for Automatic Ontology-based Annotation of Scientific Literature
Publication TypeConference Paper
Year of Publication2018
AuthorsManda, P, Beasley, L, Mohanty, S
Conference NameInternational Conference on Biomedical Ontology (ICBO 2018)
Date Published08/06/2018
PublisherInternational Conference on Biological Ontology
Keywordsautomated curation, deep learning, named entity recognition, natural language processing, Ontology
Abstract

Text mining approaches for automated ontology-based curation of biological and biomedical literature have largely focused on syntactic and lexical analysis along with machine learning. Recent advances in deep learning have shown increased accuracy for textual data annotation. However, the application of deep learning for ontology-based curation is a relatively new area and prior work has focused on a limited set of models. Here, we introduce a new deep learning model/architecture based on combining multiple Gated Recurrent Units (GRU) with a character+word based input. We use data from five ontologies in the CRAFT corpus as a Gold Standard to evaluate our model's performance. We also compare our model to seven models from prior work. We use four metrics - Precision, Recall, F1 score, and a semantic similarity metric (Jaccard similarity) to compare our model's output to the Gold Standard. Our model resulted in 84% Precision, 84% Recall, 83% F1, and 84% Jaccard similarity. Results show that our GRU-based model outperforms prior models across all five ontologies. We also observed that character+word inputs result in a higher performance across models as compared to word only inputs. These findings indicate that deep learning algorithms are a promising avenue to be explored for automated ontology-based curation of data. This study also serves as a formal comparison and guideline for building and selecting deep learning models and architectures for ontology-based curation.

URLhttp://icbo2018.cgrb.oregonstate.edu/