给我一个提示：LLM 能借助提示解决数学问题吗？
Give me a hint: Can LLMs take a hint to solve math problems?
AI总结：
本研究借鉴人类教学法，提出通过提示来提升LLM解决高等数学问题的能力，并验证了其对对抗性提示的敏感性，在MATH数据集上优于现有提示技术。
摘要：
尽管最先进的LLM在逻辑和基础数学推理方面表现不佳，近期研究尝试通过提示技术来提升其问题解决能力。我们借鉴人类数学教学法，提出给予“提示”以改善语言模型在高等数学问题上的表现。同时，我们测试了模型对对抗性提示的鲁棒性，并展示了它们对此类提示的敏感性。我们通过评估多种不同的LLM，使用MATH数据集中涵盖不同难度和主题的广泛问题集，并与一次性、少样本和思维链提示等技术进行比较，证明了我们方法的有效性。
英文摘要：
While state-of-the-art LLMs have shown poor logical and basic mathematical reasoning, recent works try to improve their problem-solving abilities using prompting techniques. We propose giving "hints" to improve the language model's performance on advanced mathematical problems, taking inspiration from how humans approach math pedagogically. We also test robustness to adversarial hints and demonstrate their sensitivity to them. We demonstrate the effectiveness of our approach by evaluating various diverse LLMs, presenting them with a broad set of problems of different difficulties and topics from the MATH dataset and comparing against techniques such as one-shot, few-shot, and chain of thought prompting.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
