IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicators
The Chinese University of Hong Kong(香港中文大学);MoE Key Laboratory of High Confidence Software Technologies(教育部高可信软件技术重点实验室);The Hong Kong Polytechnic University(香港理工大学)
Luyang Lin, Lingzhi Wang, Xiaoyan Zhao, Jing Li, Kam-Fai Wong
This study focuses on media bias detection, crucial in today's era of influential social media platforms shaping individual attitudes and opinions. In contrast to prior work that primarily relies on training specific models tailored to particular datasets, resulting in limited adaptability and subpar performance on out-of-domain data, we introduce a general bias detection framework, IndiVec, built upon large language models. IndiVec begins by constructing a fine-grained media bias database, leveraging the robust instruction-following capabilities of large language models and vector database techniques. When confronted with new input for bias detection, our framework automatically selects the most relevant indicator from the vector database and employs majority voting to determine the input's bias label. IndiVec excels compared to previous methods due to its adaptability (demonstrating consistent performance across diverse datasets from various sources) and explainability (providing explicit top-k indicators to interpret bias predictions). Experimental results on four political bias datasets highlight IndiVec's significant superiority over baselines. Furthermore, additional experiments and analysis provide profound insights into the framework's effectiveness.
Automated Data Enrichment using Confidence-Aware Fine-Grained Debate among Open-Source LLMs for Mental Health and Online Safety
University of Southampton, UK(英国南安普顿大学);Queen Mary University of London, UK(伦敦大学玛丽女王学院);The Alan Turing Institute, UK(阿兰·图灵研究所);Bar Ilan University, Israel(巴伊兰大学)
AraHalluEval: A Fine-grained Hallucination Evaluation Framework for Arabic LLMs
Information and Computer Science Department, King Fahd University of Petroleum and Minerals(信息与计算机科学系,国王法赫德石油和矿物大学);SDAIA-KFUPM Joint Research Center for Artificial Intelligence(SDAIA-KFUPM人工智能联合研究中心)
SOS-1K: A Fine-grained Suicide Risk Classification Dataset for Chinese Social Media Analysis
School of Software Engineering, Beijing University of Technology(北京工业大学软件学院);School of Nursing, Wuhan University(武汉大学护理学院);Sorbonne Université(索邦大学);Institut du Cerveau - Paris Brain Institute - ICM(大脑研究所-巴黎脑研究所-ICM);CNRS(法国国家科学研究中心);Inria(法国国家信息与自动化研究所);Inserm(法国国家健康与医学研究院);AP-HP(巴黎公共医疗集团);Hôpital de la Pitié Salpêtrière(皮蒂-萨尔皮特里医院)
SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Meituan(美团);Shanghai Jiao Tong University(上海交通大学)
Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);The Hong Kong University of Science and Technology(香港科学与技术大学);Fudan University(复旦大学);Tsinghua University(清华大学)
PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder
School of Computing, National University of Singapore(新加坡国立大学计算机学院);School of Intelligence Science and Engineering, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)智能科学与工程学院)