arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.09043cs.CLcs.AI
收藏

语言模型是填字游戏求解者

Language Models are Crossword Solvers

Indian Statistical Institute, Kolkata(印度统计研究所,加尔各答)

Soumadeep Saha, Sutanoya Chakraborty, Saptarshi Saha, Utpal Garain

AI总结:

本文研究大语言模型求解填字游戏的能力,提出结合LLM表现的搜索算法,首次用开箱即用模型完整解网格,并在隐晦线索和《纽约时报》谜题上取得显著提升。

摘要:

填字游戏是一种文字谜题,要求求解者在自然语言理解、文字游戏、推理和世界知识方面展现出高度熟练的能力,同时遵守字符和长度约束。在本文中,我们应对利用大语言模型(LLM)求解填字游戏的挑战。我们证明,当前一代语言模型在破译隐晦填字游戏线索方面表现出显著能力,并在相关基准上将先前报告的最先进(SoTA)结果提升了2至3倍。我们还开发了一种搜索算法,该算法基于这一性能,首次利用开箱即用的LLM解决完整填字游戏网格的问题,在《纽约时报》填字游戏上达到93%的准确率。此外,我们证明LLM具有良好的泛化能力,并能够用合理的依据来支持答案。

英文摘要:

Crosswords are a form of word puzzle that require a solver to demonstrate a high degree of proficiency in natural language understanding, wordplay, reasoning, and world knowledge, along with adherence to character and length constraints. In this paper we tackle the challenge of solving crosswords with large language models (LLMs). We demonstrate that the current generation of language models shows significant competence at deciphering cryptic crossword clues and outperforms previously reported state-of-the-art (SoTA) results by a factor of 2-3 in relevant benchmarks. We also develop a search algorithm that builds off this performance to tackle the problem of solving full crossword grids with out-of-the-box LLMs for the very first time, achieving an accuracy of 93% on New York Times crossword puzzles. Additionally, we demonstrate that LLMs generalize well and are capable of supporting answers with sound rationale.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑