arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.11264cs.CLcs.LG

ChatGPT数学能力的跨语言评估

Cross-Language Assessment of Mathematical Capability of ChatGPT

Thadomal Shahani Engineering College(塔多马尔沙哈尼工程学院)

Gargi Sathe, Aneesh Shamraj, Aditya Surve, Nahush Patil, Kumkum Saxena

AI总结:

本文评估ChatGPT在多种语言(尤其是印度地方语言)中的数学解题能力,并检验思维链提示能否像在英语场景中一样提升准确率。

摘要:

本文对ChatGPT在印地语、古吉拉特语和马拉地语等多种语言中的数学能力进行了评估。ChatGPT基于OpenAI的GPT-3.5,因其自然语言理解和生成能力而受到广泛关注。然而,它在跨多种自然语言求解数学问题方面的表现仍是一个相对未被探索的领域,尤其是在印度地方语言方面。本文探究了这些能力,并使用思维链提示来判断其是否能像在英语中那样提高回答的准确率,同时对当前局限性提供了洞见。

英文摘要:

This paper presents an evaluation of the mathematical capability of ChatGPT across diverse languages like Hindi, Gujarati, and Marathi. ChatGPT, based on GPT-3.5 by OpenAI, has garnered significant attention for its natural language understanding and generation abilities. However, its performance in solving mathematical problems across multiple natural languages remains a comparatively unexplored area, especially in regional Indian languages. In this paper, we explore those capabilities as well as using chain-of-thought prompting to figure out if it increases the accuracy of responses as much as it does in the English language and provide insights into the current limitations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑