How would Stance Detection Techniques Evolve after the Launch of ChatGPT?
College of Big Data and Internet, Shenzhen Technology University(深圳技术大学大数据与互联网学院);Faculty of Information and Intelligence, Shenzhen X-Institute(深圳X研究所信息与智能学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Bowen Zhang, Daijun Ding, Liwen Jing, Genan Dai, Nan Yin
Stance detection refers to the task of extracting the standpoint (Favor, Against or Neither) towards a target in given texts. Such research gains increasing attention with the proliferation of social media contents. The conventional framework of handling stance detection is converting it into text classification tasks. Deep learning models have already replaced rule-based models and traditional machine learning models in solving such problems. Current deep neural networks are facing two main challenges which are insufficient labeled data and information in social media posts and the unexplainable nature of deep learning models. A new pre-trained language model chatGPT was launched on Nov 30, 2022. For the stance detection tasks, our experiments show that ChatGPT can achieve SOTA or similar performance for commonly used datasets including SemEval-2016 and P-Stance. At the same time, ChatGPT can provide explanation for its own prediction, which is beyond the capability of any existing model. The explanations for the cases it cannot provide classification results are especially useful. ChatGPT has the potential to be the best AI model for stance detection tasks in NLP, or at least change the research paradigm of this field. ChatGPT also opens up the possibility of building explanatory AI for stance detection.
Investigating Chain-of-thought with ChatGPT for Stance Detection on Social Media
College of Big Data and Internet, Shenzhen Technology University(深圳技术大学大数据与互联网学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Shenzhen X-Institute(深圳X研究院);Academy of Cyber, Beijing(北京网络研究院)
Automated stance detection in complex topics and small languages: the challenging case of immigration in polarizing news media
School of Humanities, Tallinn University, Estonia(塔林大学人文学科学院,爱沙尼亚);Baltic Film, Media and Arts School, Tallinn University, Estonia(巴尔蒂克电影、媒体与艺术学院,塔林大学,爱沙尼亚);ERA Chair for Cultural Data Analytics, Tallinn University, Estonia(塔林大学文化数据分析埃拉教席,爱沙尼亚)
Luddy School of Informatics, Computing & Engineering(卢迪信息学、计算与工程学院);Center for Complex Networks & Systems(复杂网络与系统中心);Indiana University Network Science Institute(印第安纳大学网络科学研究所)
Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);University of Helsinki(赫尔辛基大学)
Evaluation empirique de la sécurisation et de l'alignement de ChatGPT et Gemini: analyse comparative des vulnérabilités par expérimentations de jailbreaks
Mapping ChatGPT in Mainstream Media to Unravel Jobs and Diversity Challenges: Early Quantitative Insights through Sentiment Analysis and Word Frequency Analysis
ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphs
University of Georgia(佐治亚大学);University of Texas at Arlington(德克萨斯大学阿灵顿分校);New York University Shanghai(上海纽约大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)