arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.05934cs.AI
收藏

Qwen2.5-32B:利用自洽工具集成推理解决孟加拉语数学奥林匹克问题

Qwen2.5-32B: Leveraging Self-Consistent Tool-Integrated Reasoning for Bengali Mathematical Olympiad Problem Solving

Bangladesh University of Engineering and Technology(孟加拉工程技术大学)

Saad Tahmid, Sourav Sarker

AI总结:

针对孟加拉语数学奥林匹克问题,提出基于Qwen2.5系列模型,结合提示工程、量化、工具集成推理及超参数调优的方法,在DL竞赛中验证了其有效性。

摘要:

我们提出了一种创新方法,用于解决孟加拉语数学问题,该方法是为DL Sprint 3.0 BUET CSE Fest 2024竞赛开发的。我们的方法使用先进的深度学习模型,特别是Qwen 2.5系列,并通过提示工程、模型量化和工具集成推理(TIR)进行改进,以处理复杂计算。最初,我们探索了各种模型架构,包括微调的Mistral和量化Qwen模型,并通过翻译技术、检索增强生成(RAG)和自定义数据集整理进行优化。手动超参数调整优化了温度和top-p等参数,以增强模型适应性和准确性。移除RAG和调整参数进一步提高了鲁棒性。我们的方法凸显了先进NLP技术在解决孟加拉语数学问题方面的潜力。

英文摘要:

We present an innovative approach for solving mathematical problems in Bengali, developed for the DL Sprint 3.0 BUET CSE Fest 2024 Competition. Our method uses advanced deep learning models, notably the Qwen 2.5 series, with improvements made through prompt engineering, model quantization, and Tool Integrated Reasoning (TIR) to handle complex calculations. Initially, we explored various model architectures, including fine-tuned Mistral and quantized Qwen models, refining them with translation techniques, Retrieval-Augmented Generation (RAG), and custom dataset curation. Manual hyperparameter tuning optimized parameters like temperature and top-p to enhance model adaptability and accuracy. Removal of RAG and parameter adjustments further improved robustness. Our approach highlights the potential of advanced NLP techniques in solving Bengali mathematical problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑