arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.04521cs.CLcs.IR
收藏

Automated Discovery of Mathematical Definitions in Text with Deep Neural Networks

Shamoon College of Engineering(沙蒙工程学院)

Natalia Vanetik, Marina Litvak, Sergey Shevchuk, Lior Reznik

英文摘要:

Automatic definition extraction from texts is an important task that has numerous applications in several natural language processing fields such as summarization, analysis of scientific texts, automatic taxonomy generation, ontology generation, concept identification, and question answering. For definitions that are contained within a single sentence, this problem can be viewed as a binary classification of sentences into definitions and non-definitions. In this paper, we focus on automatic detection of one-sentence definitions in mathematical texts, which are difficult to separate from surrounding text. We experiment with several data representations, which include sentence syntactic structure and word embeddings, and apply deep learning methods such as the Convolutional Neural Network (CNN) and the Long Short-Term Memory network (LSTM), in order to identify mathematical definitions. Our experiments demonstrate the superiority of CNN and its combination with LSTM, when applied on the syntactically-enriched input representation. We also present a new dataset for definition extraction from mathematical texts. We demonstrate that this dataset is beneficial for training supervised models aimed at extraction of mathematical definitions. Our experiments with different domains demonstrate that mathematical definitions require special treatment, and that using cross-domain learning is inefficient for that task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑