arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.02243cs.HCcs.AI
收藏

启动!生成模型能为人类计算工作流做什么?

Power-up! What Can Generative Models Do for Human Computation Workflows?

Delft University of Technology(代尔夫特理工大学)

Garrett Allen, Gaole He, Ujwal Gadiraju

AI总结:

本文从任务请求者、众包工人、平台和最终用户视角,提出将大语言模型引入众包工作流关键节点以增强现有人机混合设计模式的愿景。

摘要:

我们正处于人工智能研究爆发式发展的时期,尤其是围绕大语言模型(LLMs)的研究。这些模型在医学、金融、常识知识图谱和众包等领域具有广泛的应用。将LLMs作为众包工作流一部分的研究仍是一个尚未充分探索的空间。众包研究社区已经产出了一批研究成果,探讨利用混合人机智能方法管理复杂任务的工作流和方法。在众包中,LLMs的角色可以被设想为更大工作流齿轮中的一个齿轮。从实证角度看,目前人们对LLMs如何提高众包工作流的有效性以及如何评估此类工作流知之甚少。在这项工作中,我们提出了一个愿景,从参与众包范式的不同利益相关者——任务请求者、众包工人、平台和最终用户——的视角来探索这一空白。我们识别了典型众包工作流中可以引入LLMs并发挥有益作用的关键节点,并提出了增强现有人群工作设计模式的方法。

英文摘要:

We are amidst an explosion of artificial intelligence research, particularly around large language models (LLMs). These models have a range of applications across domains like medicine, finance, commonsense knowledge graphs, and crowdsourcing. Investigation into LLMs as part of crowdsourcing workflows remains an under-explored space. The crowdsourcing research community has produced a body of work investigating workflows and methods for managing complex tasks using hybrid human-AI methods. Within crowdsourcing, the role of LLMs can be envisioned as akin to a cog in a larger wheel of workflows. From an empirical standpoint, little is currently understood about how LLMs can improve the effectiveness of crowdsourcing workflows and how such workflows can be evaluated. In this work, we present a vision for exploring this gap from the perspectives of various stakeholders involved in the crowdsourcing paradigm -- the task requesters, crowd workers, platforms, and end-users. We identify junctures in typical crowdsourcing workflows at which the introduction of LLMs can play a beneficial role and propose means to augment existing design patterns for crowd work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑