arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.03034cs.CLcs.LG
收藏

基于方面的情感分析的数据高效适应与一种新颖的评估方法

Data-Efficient Adaptation and a Novel Evaluation Method for Aspect-based Sentiment Analysis

School of Computer Science, University of Auckland(计算机科学学院,奥克兰大学)

Yan Cathy Hua, Paul Denny, Jörg Wicker, Katerina Taškova

AI总结:

本研究针对ABSA在低资源领域面临的挑战,提出了一种灵活的评估方法FTS-OBP,并验证了多任务微调策略能让1.5-3.8B的小型生成模型在少量数据下超越大模型,同时发布了首个教育评论ABSA公开资源。

摘要:

基于方面的情感分析(ABSA)是一种细粒度的意见挖掘方法,用于识别和分类句子中与特定实体(方面)或其类别相关的意见。尽管其发展迅速且潜力广泛,但ABSA的研究和资源仍集中在商业领域,导致教育和医疗保健等高需求但低资源领域的分析需求未得到满足。领域适应挑战以及大多数现有方法对资源密集型的训练中知识注入的依赖,进一步阻碍了这些领域的进展。此外,基于精确匹配的传统评估方法对ABSA任务而言过于僵化,会惩罚任何边界变化,这可能无法准确反映生成模型的性能。本研究通过三项贡献填补了这些空白:1)我们提出了一种新颖的评估方法,即灵活文本相似度匹配与最优二部图配对(FTS-OBP),该方法能够适应现实的抽取边界变化,同时与传统指标保持强相关性,并提供细粒度的诊断。2)我们首次对小型仅解码器生成式语言模型(SLMs;参数量<7B)进行了ABSA研究,通过教育评论ABSA的案例研究考察了资源的下限。我们系统地探索了无数据(上下文学习和权重合并)和少数据微调方法,并提出了一种多任务微调策略,显著提升了SLM的性能,使1.5-3.8B模型能够超越专有大型模型,并在单张GPU上仅使用200-1,000个样本即可接近基准测试结果。3)我们发布了首套公开的教育评论ABSA资源,以支持未来在低资源领域的研究。

英文摘要:

Aspect-based Sentiment Analysis (ABSA) is a fine-grained opinion mining approach that identifies and classifies opinions associated with specific entities (aspects) or their categories within a sentence. Despite its rapid growth and broad potential, ABSA research and resources remain concentrated in commercial domains, leaving analytical needs unmet in high-demand yet low-resource areas such as education and healthcare. Domain adaptation challenges and most existing methods' reliance on resource-intensive in-training knowledge injection further hinder progress in these areas. Moreover, traditional evaluation methods based on exact matches are overly rigid for ABSA tasks, penalising any boundary variations which may misrepresent the performance of generative models. This work addresses these gaps through three contributions: 1) We propose a novel evaluation method, Flexible Text Similarity Matching and Optimal Bipartite Pairing (FTS-OBP), which accommodates realistic extraction boundary variations while maintaining strong correlation with traditional metrics and offering fine-grained diagnostics. 2) We present the first ABSA study of small decoder-only generative language models (SLMs; <7B parameters), examining resource lower bounds via a case study in education review ABSA. We systematically explore data-free (in-context learning and weight merging) and data-light fine-tuning methods, and propose a multitask fine-tuning strategy that significantly enhances SLM performance, enabling 1.5-3.8 B models to surpass proprietary large models and approach benchmark results with only 200-1,000 examples on a single GPU. 3) We release the first public set of education review ABSA resources to support future research in low-resource domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑