arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.00181cs.CLcs.CYcs.DL
收藏

文本距离的历史意义

The Historical Significance of Textual Distances

University of Illinois, Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Ted Underwood

摘要:

度量相似性是信息检索中的一项基本任务,现在常常是关于文化变化的更复杂论点的基石。但是,文本相似性和距离的度量真的与文化接近性和差异性的证据相对应吗?为了实证地探讨这个问题,本文比较了英语小说体裁之间相似性的文本和社会测量。现有的文本相似性度量(tf-idf向量或主题向量上的余弦相似性)也与使用监督学习在社会背景下锚定文本度量的新策略进行了比较。

英文摘要:

Measuring similarity is a basic task in information retrieval, and now often a building-block for more complex arguments about cultural change. But do measures of textual similarity and distance really correspond to evidence about cultural proximity and differentiation? To explore that question empirically, this paper compares textual and social measures of the similarities between genres of English-language fiction. Existing measures of textual similarity (cosine similarity on tf-idf vectors or topic vectors) are also compared to new strategies that use supervised learning to anchor textual measurement in a social context.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑