Promptimizer:面向个人内容分类的用户主导提示优化
Promptimizer: User-Led Prompt Optimization for Personal Content Classification
AI总结:
Promptimizer是一种以用户为中心的提示优化技术,通过允许用户输入和生成可解释提示,在保持高性能的同时,显著优于全自动方法,并已成功部署于YouTube创作者工具Puffin中。
摘要:
虽然大语言模型(LLM)现在使用户能够通过自然语言轻松创建内容分类器,但自动提示优化技术通常是创建高性能分类器所必需的。然而,此类技术可能未能考虑社交媒体用户在使用过程中希望如何演变其过滤器,包括在初始化和迭代期间希望以不同方式引导过滤器。我们提出了一种以用户为中心的提示优化技术Promptimizer,它保持了高性能和易用性,但此外(1)允许用户在优化过程中输入,(2)生成最终可解释的提示。一项实验室实验(n=16)发现,用户显著偏好Promptimizer的“人在回路”优化,而非全自动方法。我们进一步将Promptimizer实现到Puffin中,这是一个支持YouTube内容创作者创建和维护个人分类器以管理其评论的工具。在为期3周的部署中,有10位创作者参与,参与者成功创建了多样化的过滤器,以更好地了解其受众并保护其社区。
英文摘要:
While LLMs now enable users to create content classifiers easily through natural language, automatic prompt optimization techniques are often necessary to create performant classifiers. However, such techniques can fail to consider how social media users want to evolve their filters over the course of usage, including desiring to steer them in different ways during initialization and iteration. We introduce a user-centered prompt optimization technique, Promptimizer, that maintains high performance and ease-of-use but additionally (1) allows for user input into the optimization process and (2) produces final prompts that are interpretable. A lab experiment (n=16) found that users significantly preferred Promptimizer's human-in-the-loop optimization over a fully automatic approach. We further implement Promptimizer into Puffin, a tool to support YouTube content creators in creating and maintaining personal classifiers to manage their comments. Over a 3-week deployment with 10 creators, participants successfully created diverse filters to better understand their audiences and protect their communities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。