鼠疫点文本:第三次鼠疫大流行(1894-1952)暴发报告中的文本挖掘与标注
Plague Dot Text: Text mining and annotation of outbreak reports of the Third Plague Pandemic (1894-1952)
AI总结:
本研究通过文本挖掘和手动标注构建第三次鼠疫大流行暴发报告的结构化语料库,以支持流行病学概念的识别与分析。
摘要:
控制人群疾病的模型设计通常基于从过去暴发中收集的信息和数据。然而,流行病暴发从来不仅仅被统计数据所捕捉,而是通过叙述来传达,并辅以经验观察。暴发报告讨论了人群、地点和疾病之间的相关性,以推断病因、传播媒介和潜在干预措施的见解。这些叙述的问题通常是缺乏一致的结构或强有力的惯例,这阻碍了它们在更大语料库中的正式分析。我们的跨学科研究调查了第三次鼠疫大流行(1894-1952)的100多份报告,评估了构建语料库的方法,以通过文本挖掘和手动标注来提取和结构化这些叙述信息。在本文中,我们讨论了我们正在进行的探索性项目的进展,我们如何增强光学字符识别(OCR)方法以改善文本捕获,我们构建叙述和识别报告中相关实体的方法。结构化语料库通过Solr提供,支持对整个集合的搜索和分析,以供未来研究,例如,用于概念识别。我们展示了因果特征和性别差异的初步可视化,这些是基于句法类别依赖的语料库统计的结果。我们的目标是开发一些最重要的概念的结构化描述,这些概念被用来理解全球范围内第三次鼠疫大流行的流行病学。该语料库使研究人员能够集体分析报告,从而深入了解二十世纪初全球鼠疫的流行病学考量。
英文摘要:
The design of models that govern diseases in population is commonly built on information and data gathered from past outbreaks. However, epidemic outbreaks are never captured in statistical data alone but are communicated by narratives, supported by empirical observations. Outbreak reports discuss correlations between populations, locations and the disease to infer insights into causes, vectors and potential interventions. The problem with these narratives is usually the lack of consistent structure or strong conventions, which prohibit their formal analysis in larger corpora. Our interdisciplinary research investigates more than 100 reports from the third plague pandemic (1894-1952) evaluating ways of building a corpus to extract and structure this narrative information through text mining and manual annotation. In this paper we discuss the progress of our ongoing exploratory project, how we enhance optical character recognition (OCR) methods to improve text capture, our approach to structure the narratives and identify relevant entities in the reports. The structured corpus is made available via Solr enabling search and analysis across the whole collection for future research dedicated, for example, to the identification of concepts. We show preliminary visualisations of the characteristics of causation and differences with respect to gender as a result of syntactic-category-dependent corpus statistics. Our goal is to develop structured accounts of some of the most significant concepts that were used to understand the epidemiology of the third plague pandemic around the globe. The corpus enables researchers to analyse the reports collectively allowing for deep insights into the global epidemiological consideration of plague in the early twentieth century.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。