DaVinci 在 SemEval-2024 任务 9 中的表现：用少样本提示 GPT-3.5 进行非常规推理
DaVinci at SemEval-2024 Task 9: Few-shot prompting GPT-3.5 for Unconventional Reasoning
AI总结：
本文面向 SemEval-2024 BRAINTEASER 的句子谜题与词语谜题，采用 GPT-3.5 少样本提示完成非常规推理，并依据两项排行榜成绩分析两类任务差异。
摘要：
尽管自然语言处理（NLP）领域已围绕主要涉及逻辑思维的垂直思维开展了大量研究，但针对横向思维的工作仍然很少；横向思维是指从非常规视角看待问题，并挑战既有概念和观念。为推动这一方向，SemEval 2024 推出了 BRAINTEASER 任务，其中包含两类问题：句子谜题和词语谜题，它们都会违背传统常识推理与约束。本文中，我们通过在 GPT-3.5 上使用少样本提示来处理这两类问题，并深入认识了二者在本质上的差异。我们的提示策略使我们在句子谜题任务的排行榜上排名第 26 位，在词语谜题任务中排名第 15 位。
英文摘要：
While significant work has been done in the field of NLP on vertical thinking, which involves primarily logical thinking, little work has been done towards lateral thinking, which involves looking at problems from an unconventional perspective and defying existing conceptions and notions. Towards this direction, SemEval 2024 introduces the task of BRAINTEASER, which involves two types of questions -- Sentence Puzzles and Word Puzzles that defy conventional common-sense reasoning and constraints. In this paper, we tackle both types of questions using few-shot prompting on GPT-3.5 and gain insights regarding the difference in the nature of the two types. Our prompting strategy placed us 26th on the leaderboard for the Sentence Puzzle and 15th on the Word Puzzle task.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
