揭示产品评论中的双重质量:一种基于NLP的方法
Unveiling Dual Quality in Product Reviews: An NLP-Based Approach
AI总结:
本文提出基于NLP的方法检测产品评论中的双重质量问题,构建含1,957条波兰语评论的数据集,并实验多种模型,验证了方法的有效性及多语言迁移能力。
摘要:
消费者经常面临产品质量不一致的问题,尤其是当相同产品在不同市场之间存在差异时,这种情况被称为双重质量问题。为了识别和解决这一问题,需要自动化技术。本文探讨了自然语言处理(NLP)如何帮助检测此类差异,并展示了开发解决方案的完整过程。首先,我们详细描述了创建一个新的波兰语数据集的过程,该数据集包含1,957条评论,其中540条突出显示了双重质量问题。然后,我们讨论了使用各种方法的实验,如基于句子变换器的SetFit、基于变换器的编码器和大型语言模型(LLMs),包括错误分析和鲁棒性验证。此外,我们使用英语、法语和德语的意见子集评估了多语言迁移。最后,本文总结了部署和实际应用的见解。
英文摘要:
Consumers often face inconsistent product quality, particularly when identical products vary between markets, a situation known as the dual quality problem. To identify and address this issue, automated techniques are needed. This paper explores how natural language processing (NLP) can aid in detecting such discrepancies and presents the full process of developing a solution. First, we describe in detail the creation of a new Polish-language dataset with 1,957 reviews, 540 highlighting dual quality issues. We then discuss experiments with various approaches like SetFit with sentence-transformers, transformer-based encoders, and LLMs, including error analysis and robustness verification. Additionally, we evaluate multilingual transfer using a subset of opinions in English, French, and German. The paper concludes with insights on deployment and practical applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。