AI文本到行为：一项关于可操控性的研究
AI Text-to-Behavior: A Study In Steerability
AI总结：
该研究利用OCEAN人格框架和历史人物模拟，定量评估ChatGPT等LLM对人格化指令的响应与可操控性，并指出指标需随模型演进持续完善。
摘要：
本研究探讨了大型语言模型（LLM）的可操控性，尤其是OpenAI的ChatGPT各迭代版本。通过采用名为OCEAN（开放性、尽责性、外向性、宜人性、神经质）的行为心理学框架，我们定量测量了模型对定制提示的响应程度。当要求模型生成模仿外向性格的文本时，OCEAN会对语言与该行为特质的一致性进行评分。在分析中，尽管“开放性”呈现出语言上的模糊性，但“尽责性”和“神经质”在OCEAN框架中被清晰诱发，而“外向性”和“宜人性”表现出显著重叠，同时又与其他特质明确区分。研究结果凸显了GPT的多功能性，以及其识别并适应细微指令的能力。此外，历史人物模拟展示了LLM内化并投射可指令人格的能力，能够精确复现其哲学思想和对话风格。然而，LLM能力的快速进步以及某些训练技术的不透明性，使指标方案迅速退化。本研究强调以定量化角色描述LLM的可操控性，既展示其前景，也指出在使其进展与人类意图对齐方面有待进一步完善之处。
英文摘要：
The research explores the steerability of Large Language Models (LLMs), particularly OpenAI's ChatGPT iterations. By employing a behavioral psychology framework called OCEAN (Openness, Conscientiousness, Extroversion, Agreeableness, Neuroticism), we quantitatively gauged the model's responsiveness to tailored prompts. When asked to generate text mimicking an extroverted personality, OCEAN scored the language alignment to that behavioral trait. In our analysis, while "openness" presented linguistic ambiguity, "conscientiousness" and "neuroticism" were distinctly evoked in the OCEAN framework, with "extroversion" and "agreeableness" showcasing a notable overlap yet distinct separation from other traits. Our findings underscore GPT's versatility and ability to discern and adapt to nuanced instructions. Furthermore, historical figure simulations highlighted the LLM's capacity to internalize and project instructible personas, precisely replicating their philosophies and dialogic styles. However, the rapid advancements in LLM capabilities and the opaque nature of some training techniques make metric proposals degrade rapidly. Our research emphasizes a quantitative role to describe steerability in LLMs, presenting both its promise and areas for further refinement in aligning its progress to human intentions.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
