位置工程:通过位置信息操控增强大语言模型
Position Engineering: Boosting Large Language Models through Positional Information Manipulation
AI总结:
本文提出位置工程方法,仅通过调整提示中的位置信息而非修改文本来引导大语言模型,并在RAG和ICL场景中验证其显著优于基线。
摘要:
大语言模型(LLMs)的性能在很大程度上受到所提供提示质量的影响。为此,研究者们已经开发了大量提示工程策略,旨在修改提示文本以提升任务性能。在本文中,我们提出了一种名为位置工程的新技术,它为引导大语言模型提供了一种更高效的方式。与需要付出大量努力来修改提供给LLMs的文本的提示工程不同,位置工程仅涉及改变提示中的位置信息,而无需修改文本本身。我们在两种广泛使用的LLM场景中评估了位置工程:检索增强生成(RAG)和上下文学习(ICL)。我们的研究结果表明,在这两种场景下,位置工程都显著优于基线方法。因此,位置工程代表了一种利用大语言模型能力的有前景的新策略。
英文摘要:
The performance of large language models (LLMs) is significantly influenced by the quality of the prompts provided. In response, researchers have developed enormous prompt engineering strategies aimed at modifying the prompt text to enhance task performance. In this paper, we introduce a novel technique termed position engineering, which offers a more efficient way to guide large language models. Unlike prompt engineering, which requires substantial effort to modify the text provided to LLMs, position engineering merely involves altering the positional information in the prompt without modifying the text itself. We have evaluated position engineering in two widely-used LLM scenarios: retrieval-augmented generation (RAG) and in-context learning (ICL). Our findings show that position engineering substantially improves upon the baseline in both cases. Position engineering thus represents a promising new strategy for exploiting the capabilities of large language models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。