Pushing The Limit of LLM Capacity for Text Classification
The Hong Kong Polytechnic University(香港理工大学);Zhengzhou University of Light Industry(郑州轻工业大学);Copenhagen University(哥本哈根大学);Halmstad University(哈尔姆斯塔德大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
The value of text classification's future research has encountered challenges and uncertainties, due to the extraordinary efficacy demonstrated by large language models (LLMs) across numerous downstream NLP tasks. In this era of open-ended language modeling, where task boundaries are gradually fading, an urgent question emerges: have we made significant advances in text classification under the full benefit of LLMs? To answer this question, we propose RGPT, an adaptive boosting framework tailored to produce a specialized text classification LLM by recurrently ensembling a pool of strong base learners. The base learners are constructed by adaptively adjusting the distribution of training samples and iteratively fine-tuning LLMs with them. Such base learners are then ensembled to be a specialized text classification LLM, by recurrently incorporating the historical predictions from the previous learners. Through a comprehensive empirical comparison, we show that RGPT significantly outperforms 8 SOTA PLMs and 7 SOTA LLMs on four benchmarks by 1.36% on average. Further evaluation experiments show a clear surpassing of RGPT over human classification.
Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features
RWTH-Aachen University(亚琛工业大学);University of Amsterdam(阿姆斯特丹大学)
人格心理学、计算机科学和语言学的交叉研究最近越来越多地关注从语言使用中建模和预测人格。我们报告了从文本数据预测人格特质的两个主要改进:(1)据我们所知,最全面的基于理论的心理语言学特征集和(2)混合模型,该模型集成了预训练的Transformer语言模型BERT和双向长短期记忆(BLSTM)网络,这些网络在心理语言学特征的文本内分布(“文本轮廓”)上进行训练。我们使用BLSTM模型(有和没有注意力)进行实验,并使用两种技术来应用来自Transformer模型的预训练语言表示-“基于特征”和“微调”。我们评估了我们在两个基准数据集上构建的模型的性能,这两个基准数据集针对两个主要的人格理论模型:Big Five Essay数据集和MBTI Kaggle数据集。我们的结果令人鼓舞,因为我们的模型在相同的数据集上优于现有的工作。更具体地说,我们的模型在Essay数据集上的分类准确率提高了2.9%,在Kaggle MBTI数据集上提高了8.28%。此外,我们进行消融实验,以量化不同类别的心理语言学特征在各自的人格预测模型的影响。
University of Illinois at Urbana-Champaign, USA(伊利诺伊大学厄巴纳-香槟分校,美国);University of California at San Diego, USA(加利福尼亚大学圣地亚哥分校,美国);IBM-Illinois Center for Cognitive Computing Systems Research (C3SR), USA(IBM-伊利诺伊认知计算系统研究中心(C3SR),美国);IBM Thomas J. Watson Research Center, USA(IBM托马斯·J·沃森研究中心,美国)