MegaChat: 一个用于高质量销售聊天机器人评估的合成波斯语问答数据集
MegaChat: A Synthetic Persian Q&A Dataset for High-Quality Sales Chatbot Evaluation
AI总结：
MegaChat通过自动化多代理架构生成高质量波斯语问答数据，用于评估销售聊天机器人，优于传统RAG模型。
摘要：
伊朗的小型和中型企业在Telegram上越来越多地利用其进行销售，实时互动对于转化至关重要。然而，为了开发AI驱动的聊天机器人，需要大量高质量的问题和答案（Q&A）数据集，这些数据集通常昂贵且资源密集，尤其是对于资源较少的语言如波斯语而言。在本文中，我们介绍了MegaChat，这是首个完全合成的波斯语问答数据集，旨在评估基于Telegram的电子商务中的智能销售聊天机器人。我们提出了一种新颖的自动化多代理架构，通过收集活跃的Telegram购物频道数据生成具有角色意识的问答对。该系统采用专门的代理进行问题生成、验证和细化，确保生成真实且多样的对话数据。为了评估回答生成，我们比较了三种经典的检索增强生成（RAG）模型与我们的先进代理系统，后者具有多查询检索、重排序和角色对齐的回答合成功能。使用GPT-5.1在六个质量维度上进行评估，我们的结果表明，代理架构在5种不同的渠道中超越了传统RAG模型，证明了其生成可扩展、高质量数据集的能力，而无需依赖昂贵的人工标注或复杂的微调。MegaChat为中小企业提供了一种高效、经济的解决方案，用于在专业商业领域构建智能客户互动系统，推动了低资源语言的多语言对话AI的进步。下载：https://github.com/MegaChat-Tech/MegaChat-DataSet
英文摘要：
Small and medium-sized enterprises (SMEs) in Iran increasingly leverage Telegram for sales, where real-time engagement is essential for conversion. However, developing AI-driven chatbots for this purpose requires large, high-quality question-and-answer (Q&A) datasets, which are typically expensive and resource-intensive to produce, especially for low-resource languages like Persian. In this paper, we introduce MegaChat, the first fully synthetic Persian Q&A dataset designed to evaluate intelligent sales chatbots in Telegram-based e-commerce. We propose a novel, automated multi-agent architecture that generates persona-aware Q&A pairs by collecting data from active Telegram shopping channels. The system employs specialized agents for question generation, validation, and refinement, ensuring the production of realistic and diverse conversational data. To evaluate answer generation, we compare three classic retrieval-augmented generation (RAG) models with our advanced agentic system, which features multi-query retrieval, reranking, and persona-aligned response synthesis. Using GPT-5.1 for evaluation across six quality dimensions, our results show that the agentic architecture outperformed traditional RAG models in 4 out of 5 diverse channels, demonstrating its ability to generate scalable, high-quality datasets without relying on expensive human annotation or complex fine-tuning. MegaChat provides SMEs with an efficient, cost-effective solution for building intelligent customer engagement systems in specialized commercial domains, enabling advancements in multilingual conversational AI for low-resource languages. Download: https://github.com/MegaChat-Tech/MegaChat-DataSet
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
