arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.07725cs.CLstat.ME
收藏

数据到价值:一种面向自然语言项目的评估优先方法

Data-to-Value: An Evaluation-First Methodology for Natural Language Projects

University of Zurich(苏黎世大学);Thomson Reuters(汤森路透);Essex University(埃塞克斯大学);Coburg University of Applied Sciences(科堡应用科学大学);University of Sheffield(谢菲尔德大学)

Jochen L. Leidner

摘要:

大数据,即大规模地收集、存储和处理数据,最近由于由应用级分布式并行操作系统(如HDFS/Hadoop/Spark)驱动的商品计算机集群的到来而成为可能,并且这样的基础设施已经大规模地革命化了数据采掘。为了使数据采掘项目更加一致地取得成功,开发了一些方法(例如CRISP-DM,SEMMA,KDD),但这些方法没有考虑到(1)非常大规模的处理,(2)处理文本(非结构化)数据(即自然语言处理(NLP,“文本分析”)),以及(3)非技术考虑因素(例如法律,道德,项目管理方面)。为了解决这些缺点,引入了一种称为“数据到价值”(D2 V)的新方法,该方法由详细的问题目录指导,以避免大数据文本分析项目团队在面对通常与方法相关的相当抽象的框和箭头图时与主题脱节。

英文摘要:

Big data, i.e. collecting, storing and processing of data at scale, has recently been possible due to the arrival of clusters of commodity computers powered by application-level distributed parallel operating systems like HDFS/Hadoop/Spark, and such infrastructures have revolutionized data mining at scale. For data mining project to succeed more consistently, some methodologies were developed (e.g. CRISP-DM, SEMMA, KDD), but these do not account for (1) very large scales of processing, (2) dealing with textual (unstructured) data (i.e. Natural Language Processing (NLP, "text analytics"), and (3) non-technical considerations (e.g. legal, ethical, project managerial aspects). To address these shortcomings, a new methodology, called "Data to Value" (D2V), is introduced, which is guided by a detailed catalog of questions in order to avoid a disconnect of big data text analytics project team with the topic when facing rather abstract box-and-arrow diagrams commonly associated with methodologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑