arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.01673cs.CV
收藏

文章中子文本块的内容显著性分布及其在文章组织评估中的应用

Content Significance Distribution of Sub-Text Blocks in Articles and Its Application to Article-Organization Assessment

1 Richard Miner School of Computer \& Information Sciences, University of Massachusetts, Lowell, MA 01854, USA

You Zhou, Jie Wang

AI总结:

本文提出子文本块的内容显著性分布(CSD-1和CSD-2),利用SentenceTransformer和MoverScore衡量文本相似度,并通过近似算法解决计算复杂度问题,最终训练SVC分类器实现高准确度的文章组织评估。

摘要:

我们探讨如何捕捉文章中子文本块的显著性,以及如何将其应用于文本挖掘任务。子文本块是文章中句子的子序列。我们提出了子文本块的内容显著性分布(CSD)的概念,称为第一类CSD,记为CSD-1。具体而言,我们利用Hugging Face的SentenceTransformer生成上下文句子嵌入,并在文本嵌入上使用MoverScore来衡量子文本块与整个文本的相似度。为克服子文本块数量的指数级增长问题,我们提出了一种近似算法,并证明近似CSD-1与精确CSD-1几乎相同。在这种近似下,我们展示了新闻、学术研究、议论和叙事文章的平均和中位数CSD-1共享相同模式。我们还表明,在某种线性变换下,具有特定$α$和$β$值的beta分布的累积分布函数的补集类似于CSD-1曲线。随后,我们利用CSD-1提取语言特征,训练SVC分类器以评估文章的组织程度。实验表明,该方法在评估学生作文时具有高准确率。此外,我们研究了句子位置的CSD,称为第二类CSD,记为CSD-2,并展示不同类型文章的平均CSD-2具有独特模式,这些模式要么符合对文章结构的普遍认知,要么提供了轻微偏差的修正。

英文摘要:

We explore how to capture the significance of a sub-text block in an article and how it may be used for text mining tasks. A sub-text block is a sub-sequence of sentences in the article. We formulate the notion of content significance distribution (CSD) of sub-text blocks, referred to as CSD of the first kind and denoted by CSD-1. In particular, we leverage Hugging Face's SentenceTransformer to generate contextual sentence embeddings, and use MoverScore over text embeddings to measure how similar a sub-text block is to the entire text. To overcome the exponential blowup on the number of sub-text blocks, we present an approximation algorithm and show that the approximated CSD-1 is almost identical to the exact CSD-1. Under this approximation, we show that the average and median CSD-1's for news, scholarly research, argument, and narrative articles share the same pattern. We also show that under a certain linear transformation, the complement of the cumulative distribution function of the beta distribution with certain values of $α$ and $β$ resembles a CSD-1 curve. We then use CSD-1's to extract linguistic features to train an SVC classifier for assessing how well an article is organized. Through experiments, we show that this method achieves high accuracy for assessing student essays. Moreover, we study CSD of sentence locations, referred to as CSD of the second kind and denoted by CSD-2, and show that average CSD-2's for different types of articles possess distinctive patterns, which either conform common perceptions of article structures or provide rectification with minor deviation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑