In the era of large AI models, the complex architecture and vast parameters present substantial challenges for effective AI quality management (AIQM), e.g. large language model (LLM). This paper focuses on investigating the quality assurance of a specific LLM-based AI product--a ChatGPT-based sentiment analysis system. The study delves into stability issues related to both the operation and robustness of the expansive AI model on which ChatGPT is based. Experimental analysis is conducted using benchmark datasets for sentiment analysis. The results reveal that the constructed ChatGPT-based sentiment analysis system exhibits uncertainty, which is attributed to various operational factors. It demonstrated that the system also exhibits stability issues in handling conventional small text attacks involving robustness.
Leveraging ChatGPT As Text Annotation Tool For Sentiment Analysis
College of Science and Engineering, Hamad Bin Khalifa University(哈马德·本·哈利法大学科学与工程学院);Department of Electronic and Computer Engineering, HKUST(香港科技大学电子与计算机工程系)
Public Attitudes Toward ChatGPT on Twitter: Sentiments, Topics, and Occupations
Indiana University–Purdue University Indianapolis(印第安纳大学-普渡大学印第安纳波利斯分校);Luddy School of Informatics, Computing, and Engineering, Indiana University–Purdue University Indianapolis(印第安纳大学-普渡大学印第安纳波利斯分校勒迪信息学、计算与工程学院);Department of Computer Science, Indiana University–Purdue University Indianapolis(印第安纳大学-普渡大学印第安纳波利斯分校计算机科学系)
Leveraging Explainable AI to Analyze Researchers' Aspect-Based Sentiment about ChatGPT
California State University Fullerton(加州州立大学富勒顿分校);Western Michigan University(西密歇根大学);Office of the Deputy Assistant Secretary of the Army (Procurement), ASA (ALT)(陆军副助理部长办公室(采购),陆军助理部长(后勤与资源))
Mapping ChatGPT in Mainstream Media to Unravel Jobs and Diversity Challenges: Early Quantitative Insights through Sentiment Analysis and Word Frequency Analysis
A Soft Contrastive Learning-based Prompt Model for Few-shot Sentiment Analysis
School of Computer Science, Fudan University(复旦大学计算机科学学院);CEC GienTech Technology Co.,Ltd.(中电金信技术有限公司);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Lab of Artificial Intelligence for Education, East China Normal University(华东师范大学教育人工智能实验室)
Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models
King Fahd University of Petroleum and Minerals(法赫德国王石油与矿业大学);ARBML;SDAIA-KFUPM Joint Research Center for Artificial Intelligence(沙特数据与人工智能局-法赫德国王石油与矿业大学人工智能联合研究中心);Volvo Cars R&D Tech Center(沃尔沃汽车研发技术中心)
Improving Large Models with Small models: Lower Costs and Better Performance
School of Computer and Artificial Intelligence of Zhengzhou University(郑州大学计算机与人工智能学院);Zhengzhou University Engineering Research Center of Intelligent Swarm Systems(郑州大学智能集群系统工程研究中心);Zhejiang University(浙江大学)
Learning to Prompt in the Classroom to Understand AI Limits: A pilot study
Università degli Studi di Milano Bicocca(米兰比可卡大学);Universitat Pompeu Fabra(庞培法布拉大学);University of Regensburg(雷根斯堡大学);Politecnico di Milano(米兰理工大学);Università degli Studi di Milano(米兰大学);Istituto per le Tecnologie Didattiche (ITD-CNR)(意大利国家研究委员会教育技术研究所)
Review-LLM: Harnessing Large Language Models for Personalized Review Generation
School of New Media Communication, Tianjin University(天津大学新媒体与传播学院);Du Xiaoman Financial(度小满金融);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)