Allies:使用束搜索提示大型语言模型
Allies: Prompting Large Language Model with Beam Search
AI总结:
提出ALLIES方法,利用LLMs迭代生成相关查询以扩展原始查询范围,捕获隐藏知识,在零样本开放域问答任务中显著优于其他基线。
摘要:
随着大型语言模型(LLMs)的进步,LLM应用研究领域变得越来越受欢迎,通过堆叠LLM API调用来构建流水线以完成复杂任务的想法成为现实。然而,这类方法面临两个局限性:信息覆盖面窄和容错率低。在这项工作中,我们提出了一种名为ALLIES的新方法。给定一个输入查询,ALLIES利用LLMs迭代地生成与原始查询相关的新查询,从而实现迭代推理过程。通过迭代地细化和扩展原始查询的范围,ALLIES捕获并利用了可能无法通过检索直接获取的隐藏知识。我们将零样本开放域问答(ODQA)作为应用场景,并在广泛使用的基准上评估ALLIES,如NQ、WebQ和TriviaQA。实验结果表明,ALLIES显著优于其他零样本基线,表明其在应对这些挑战方面的有效性。我们的代码可在https://github.com/microsoft/SimXNS/tree/main/ALLIES获取。
英文摘要:
With the advance of large language models (LLMs), the research field of LLM applications becomes more and more popular and the idea of constructing pipelines to accomplish complex tasks by stacking LLM API calls come true. However, this kind of methods face two limitations: narrow information coverage and low fault tolerance. In this work, we propose a novel method called ALLIES. Given an input query, ALLIES leverages LLMs to iteratively generate new queries related to the original query, enabling an iterative reasoning process. By iteratively refining and expanding the scope of the original query, ALLIES captures and utilizes hidden knowledge that may not be directly obtainable through retrieval. We take zero-shot open-domain question answering (ODQA) as an application scene and evaluate ALLIES on the widely-used benchmarks, such as NQ, WebQ and TriviaQA. The experimental results demonstrate that ALLIES significantly outperforms other zero-shot baselines, indicating its effectiveness in tackling those challenges. Our code is available in https://github.com/microsoft/SimXNS/tree/main/ALLIES.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。