arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.01294cs.LGcs.AIcs.CL
收藏

通过端到端上下文感知聚类为开放式响应调查提供见解

Providing Insights for Open-Response Surveys via End-to-End Context-Aware Clustering

Apple(苹果公司)

Soheil Esmaeilzadeh, Brian Williams, Davood Shamsi, Onar Vikingstad

摘要:

教师经常进行调查,以便从预定义的学生群体中收集数据,以深入了解感兴趣的主题。在分析具有开放式文本回复的调查时,手动将所有回复处理成一份有洞察力的综合报告是非常耗时、劳动密集型的,而且很难。在分析步骤中,传统上,教师必须阅读每一个回答,并决定如何将它们分组,以提取有见地的信息。即使可以仅使用某些关键字对响应进行分组,这种方法也会受到限制,因为它不仅不能考虑嵌入式上下文,而且不能检测多义词或短语以及无法用单个词表达的语义。在这项工作中,我们提出了一种新型的端到端上下文感知框架,可以提取、聚合和缩写开放响应调查数据中的嵌入式语义模式。我们的框架依赖于一个预先训练好的自然语言模型,以便将文本数据编码成语义向量。然后,编码的向量被聚类成最佳调整数量的组或具有预先指定的标题的组的集合。在前一种情况下,然后进一步分析聚类以提取用作聚类的标签的代表性的关键字或摘要句子集合。在我们的框架中,对于指定的集群,我们最终提供了上下文感知的词云,展示了每个组中语义突出的关键字。为了尊重用户隐私,我们成功地构建了适合移动设备上实时分析的框架的设备上实现,并在合成数据集上进行了测试。我们的框架通过自动化从调查数据中提取最具洞察力的信息片段的过程来大规模降低成本。

英文摘要:

Teachers often conduct surveys in order to collect data from a predefined group of students to gain insights into topics of interest. When analyzing surveys with open-ended textual responses, it is extremely time-consuming, labor-intensive, and difficult to manually process all the responses into an insightful and comprehensive report. In the analysis step, traditionally, the teacher has to read each of the responses and decide on how to group them in order to extract insightful information. Even though it is possible to group the responses only using certain keywords, such an approach would be limited since it not only fails to account for embedded contexts but also cannot detect polysemous words or phrases and semantics that are not expressible in single words. In this work, we present a novel end-to-end context-aware framework that extracts, aggregates, and abbreviates embedded semantic patterns in open-response survey data. Our framework relies on a pre-trained natural language model in order to encode the textual data into semantic vectors. The encoded vectors then get clustered either into an optimally tuned number of groups or into a set of groups with pre-specified titles. In the former case, the clusters are then further analyzed to extract a representative set of keywords or summary sentences that serve as the labels of the clusters. In our framework, for the designated clusters, we finally provide context-aware wordclouds that demonstrate the semantically prominent keywords within each group. Honoring user privacy, we have successfully built the on-device implementation of our framework suitable for real-time analysis on mobile devices and have tested it on a synthetic dataset. Our framework reduces the costs at-scale by automating the process of extracting the most insightful information pieces from survey data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑