Adverse Drug Events Detection in Clinical Notes by Jointly Modeling Entities and Relations Using Neural Networks
Drug SafetyPublished 1 January 2019
Bharath Dandala, Venkata Joopudi, Murthy Devarakonda
Citations81
SJR quartileQ1
SJR score1.13
SNIP1.34
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is important to use joint modeling techniques and external resources for effectively detecting ADEs from clinical narratives in electronic health record (EHR) systems while the extraction of entities and relations individually achieved high accuracy, the integrated task still has room for further improvement.
Abstract
It is important to use joint modeling techniques and external resources for effectively detecting ADEs from clinical narratives in electronic health record (EHR) systems. While the extraction of entities and relations individually achieved high accuracy, the integrated task still has room for further improvement.
Keywords
MedicineBiochemistry, Genetics and Molecular BiologyPharmacology, Toxicology and Pharmaceutics
Neural ComputationLong Short-Term Memory
98,079 Citations1997Sepp Hochreiter, Jürgen Schmidhuber
A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
50,318 Citations2021Mandi, Jayanta, Canoy, Rocsildes +2 more
A simple numeric simulation of DNA-co-polymerized hydrogel shape change and a genetic algorithm that generates and selects large batches of material designs that compete with one another to evolve and converge on optimal objective-matching designs are constructed.
IEEE Transactions on Neural NetworksLearning long-term dependencies with gradient descent is difficult
8,461 Citations1994Yoshua Bengio, P. Simard +1 more
This work shows why gradient based learning algorithms face an increasingly difficult problem as the duration of the dependencies to be captured increases, and exposes a trade-off between efficient learning by gradient descent and latching on information for long periods.
Neural NetworksFramewise phoneme classification with bidirectional LSTM and other neural network architectures
5,463 Citations2005Alex Graves, Jürgen Schmidhuber
The main findings are that bidirectional networks outperform unidirectional ones, and Long Short Term Memory (LSTM) is much faster and also more accurate than both standard Recurrent Neural Nets (RNNs) and time-windowed Multilayer Perceptrons (MLPs).
arXiv (Cornell University)Natural Language Processing (almost) from Scratch
5,172 Citations2011Ronan Collobert, Jason Weston +4 more
Neural Architectures for Named Entity Recognition
4,428 Citations2016Guillaume Lample, Miguel Ballesteros +3 more
Comunicacio presentada a la 2016 Conference of the North American Chapter of the Association for Computational Linguistics, celebrada a San Diego (CA, EUA) els dies 12 a 17 of juny 2016.
Nucleic Acids ResearchThe Unified Medical Language System (UMLS): integrating biomedical terminology
4,224 Citations2003Olivier Bodenreider
The Unified Medical Language System is a repository of biomedical vocabularies developed by the US National Library of Medicine and includes tools for customizing the Metathesaurus (MetamorphoSys), for generating lexical variants of concept names (lvg) and for extracting UMLS concepts from text (MetaMap).
Leibniz-Zentrum für Informatik (Schloss Dagstuhl)NER in Archival Finding Aids
3,270 Citations2021Zhiheng Huang, Wei Xu +1 more
This work has created a set of datasets to train Machine Learning algorithms to find named entities and geographical locations and tested them in several datasets and registered their precision and accuracy.
Leibniz-Zentrum für Informatik (Schloss Dagstuhl)LOL: An Investigation into Cybernetic Humor, or: Can Machines Laugh?
3,084 Citations2016Alex Graves, Gervasi, Vincenzo +1 more
This paper shows how Long Short-term Memory recurrent neural networks can be used to generate complex sequences with long-range structure, simply by predicting one data point at a time.
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
2,589 Citations2016Xuezhe Ma, Eduard Hovy
A novel neutral network architecture is introduced that benefits from both word- and character-level representations automatically, by using combination of bidirectional LSTM, CNN and CRF, thus making it applicable to a wide range of sequence labeling tasks.
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
2,033 Citations2016Peng Zhou, Wei Shi +5 more
The experimental results on the SemEval-2010 relation classification task show that the AttBLSTM method outperforms most of the existing methods, with only word vectors.
Scientific DataDistributed solar photovoltaic array location and extent dataset for remote sensing object identification
634 Citations2016Kyle Bradbury, Raghav Saboo +6 more
This work created a dataset of solar PV arrays to initiate and develop the process of automatically identifying solar PV locations using remote sensing imagery, and contains the geospatial coordinates and border vertices for over 19,000 solar panels across 601 high-resolution images from four cities in California.
BioinformaticsDeep learning with word embeddings improves biomedical named entity recognition
566 Citations2017Maryam Habibi, Leon Weber +3 more
This work shows that a completely generic method based on deep learning and statistical word embeddings [called long short‐term memory network‐conditional random field (LSTM‐CRF)] outperforms state‐of‐the‐art entity‐specific NER tools, and often by a large margin.
Foundations and Trends® in Machine LearningAn Introduction to Conditional Random Fields
529 Citations2012Charles Sutton
Transactions of the Association for Computational LinguisticsCross-Sentence <i>N</i>-ary Relation Extraction with Graph LSTMs
458 Citations2017Nanyun Peng, Hoifung Poon +3 more
A general relation extraction framework based on graph long short-term memory networks (graph LSTMs) that can be easily extended to cross-sentence n-ary relation extraction is explored, demonstrating its effectiveness with both conventional supervised learning and distant supervision.
arXiv (Cornell University)Relation Classification via Recurrent Neural Network
283 Citations2015Dongxu Zhang, Dong Wang
Experiments strongly indicates that the RNN-based model can deliver better performance on relation classification, and it is particularly capable of learning long-distance relation patterns, which makes it suitable for real-world applications where complicated expressions are often involved.
BMC BioinformaticsA neural joint model for entity and relation extraction from biomedical text
253 Citations2017Fei Li, Meishan Zhang +2 more
It is demonstrated that the model based on neural networks is effective for biomedical entity and relation extraction and parameter sharing is an alternative method for neural models to jointly process this task.
Scientific DataA curated and standardized adverse drug event resource to accelerate drug safety research
247 Citations2016Juan M. Banda, Lee Evans +4 more
This work provides a curated and standardized version of FAERS removing duplicate case records, applying standardized vocabularies with drug names mapped to RxNorm concepts and outcomes mapped to SNOMED-CT concepts, and pre-computed summary statistics about drug-outcome relationships for general consumption.
BMC BioinformaticsBon-EV: an improved multiple testing procedure for controlling false discovery rates
206 Citations2017Dongmei Li, Zidian Xie +3 more
A new multiple testing procedure, named Bon-EV, to control false discovery rate (FDR) based on Bonferroni’s approach is proposed, available as the BonEV package in R for download at https://CRAN.R-project.org/package=BonEV.
Structured prediction models for RNN based sequence labeling in clinical text
201 Citations2016Abhyuday Jagannatha, Hong Yu
This work extends the previously studied LSTM-CRF models with explicit modeling of pairwise potentials and proposes an approximate version of skip-chain CRF inference with RNN potentials to improve the exact phrase detection of various medical entities.
BMC BioinformaticsAn attention-based effective neural model for drug-drug interactions extraction
151 Citations2017Wei Zheng, Hongfei Lin +6 more
JMIR Public Health and SurveillanceClinical Relation Extraction Toward Drug Safety Surveillance Using Electronic Health Record Narratives: Classical Learning Versus Deep Learning
75 Citations2018Tsendsuren Munkhdalai, Feifan Liu +1 more
Evaluating natural language processing and machine learning approaches using the expert-annotated medical entities and relations in the context of drug safety surveillance shows that classical learning models (SVM) remains advantageous over deep learning models(RNN variants) for clinical relation identification, especially for long-distance intersentential relations.
Pattern Recognition LettersRecognizing irregular entities in biomedical text via deep neural networks
48 Citations2017Fei Li, Meishan Zhang +4 more
A neural network model called Bi-LSTM-CRF that consists of bidirectional (Bi) long short-term memories (LSTMs) and conditional random fields (CRFs) to identify regular entities and the components of irregular entities and it is shown that the method of automatically combining the components is as effective as the methods of manually designing rules.
Extracting Relations Within and Across Sentences
45 Citations2011Kumutha Swampillai, Mark Stevenson
It was found that the structured features used for intrasentential relation extraction can be easily adapted for the inter-sentential case and provides comparable performance.
PubMedA Quantitative and Qualitative Evaluation of Sentence Boundary Detection for the Clinical Domain.
31 Citations2016Denis Newman-Griffis, Chaitanya Shivade +2 more
Five popular off-the-shelf NLP toolkits are evaluated on the task of SBD in various kinds of text using a diverse set of corpora, including the GENIA corpus of biomedical abstracts, a corpus of clinical notes used in the 2010 i2b2 shared task, and two general-domain corpora.
Stacking With Auxiliary Features for Entity Linking in the Medical Domain
13 Citations2017Nazneen Fatema Rajani, Mihaela Bornea +1 more
This paper describes the process for building a Stacking ensemble using additional, auxiliary features for Entity Linking in the medical domain, and reports experiments that show that naive ensembling does not always outperform component Entity Linked systems, that stacking usually outperforms naiveEnsembling, and that auxiliary features added to the stacker further improve its performance on three distinct datasets.
Data from: A curated and standardized adverse drug event resource to accelerate drug safety research
8 Citations2015Juan M. Banda, Lee Evans +4 more
International Conference on Computational LinguisticsScoring Disease-Medication Associations using Advanced NLP, Machine Learning, and Multiple Content Sources.
2 Citations2016Bharath Dandala, Murthy Devarakonda +2 more
Two new methods for building a knowledge resource of disease to medication associations based on advanced natural language processing and machine learning techniques are described, one using distributional semantics on large medical text, and the other using data mining on a large number of patient records.