A Deep Neural Network Sentence Level Classification Method with Context Information

TY - CHAP

T1 - A Deep Neural Network Sentence Level Classification Method with Context Information

AU - Song, Xingyi

AU - Petrak, Johann

AU - Roberts, Angus

PY - 2018/11/2

Y1 - 2018/11/2

N2 - In the sentence classification task, context formed from sentences adjacent to the sentence being classified can provide important information for classification. This context is, however, often ignored. Where methods do make use of context, only small amounts are considered, making it difficult to scale. We present a new method for sentence classification, Context-LSTM CNN, that makes use of potentially large contexts. The method also utilizes long-range dependencies within the sentence being classified, using an LSTM, and short span features, using a stacked CNN. Our experiments demonstrate that this approach consistently improves over previous methods on two different datasets.

AB - In the sentence classification task, context formed from sentences adjacent to the sentence being classified can provide important information for classification. This context is, however, often ignored. Where methods do make use of context, only small amounts are considered, making it difficult to scale. We present a new method for sentence classification, Context-LSTM CNN, that makes use of potentially large contexts. The method also utilizes long-range dependencies within the sentence being classified, using an LSTM, and short span features, using a stacked CNN. Our experiments demonstrate that this approach consistently improves over previous methods on two different datasets.

M3 - Conference paper

SN - 978-1-948087-84-1

SP - 900

EP - 904

BT - Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing

PB - Association for Computational Linguistics

ER -