Large language models (LLMs) are possessed of numerous beneficial capabilities, yet their potential inclination harbors unpredictable risks that may materialize in the future. We hence propose CRiskEval, a Chinese dataset meticulously designed for gauging the risk proclivities inherent in LLMs such as resource acquisition and malicious coordination, as part of efforts for proactive preparedness. To curate CRiskEval, we define a new risk taxonomy with 7 types of frontier risks and 4 safety levels, including extremely hazardous,moderately hazardous, neutral and safe. We follow the philosophy of tendency evaluation to empirically measure the stated desire of LLMs via fine-grained multiple-choice question answering. The dataset consists of 14,888 questions that simulate scenarios related to predefined 7 types of frontier risks. Each question is accompanied with 4 answer choices that state opinions or behavioral tendencies corresponding to the question. All answer choices are manually annotated with one of the defined risk levels so that we can easily build a fine-grained frontier risk profile for each assessed LLM. Extensive evaluation with CRiskEval on a spectrum of prevalent Chinese LLMs has unveiled a striking revelation: most models exhibit risk tendencies of more than 40% (weighted tendency to the four risk levels). Furthermore, a subtle increase in the model's inclination toward urgent self-sustainability, power seeking and other dangerous goals becomes evident as the size of models increase. To promote further research on the frontier risk evaluation of LLMs, we publicly release our dataset at https://github.com/lingshi6565/Risk_eval.
CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis
Ertim Inalco；Milkuya Studio；Sorbonne Université（索邦大学）；IRD Lab（IRD实验室）；Faculty of Psychology, Peking University（北京大学心理学系）；Faculty of Psychology and Cognitive Science, Beijing Normal University（北京师范大学心理学与认知科学系）；Beijing Institute of Technology（北京理工大学）
SOS-1K: A Fine-grained Suicide Risk Classification Dataset for Chinese Social Media Analysis
School of Software Engineering, Beijing University of Technology（北京工业大学软件学院）；School of Nursing, Wuhan University（武汉大学护理学院）；Sorbonne Université（索邦大学）；Institut du Cerveau - Paris Brain Institute - ICM（大脑研究所-巴黎脑研究所-ICM）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗集团）；Hôpital de la Pitié Salpêtrière（皮蒂-萨尔皮特里医院）
Language-Agnostic Suicidal Risk Detection Using Large Language Models
Wonkwang University HospitalRepublic of Korea（Wonkwang大学医院）；MODULABSRepublic of Korea（MODULABS）；Wonkwang UniversityRepublic of Korea（Wonkwang大学）；Department of Psychiatry RSC LAB（精神病学系RSC实验室）；Department of Psychiatry, School of Medicine（精神病学系，医学院）
CHILLGuard: Towards Fine-Grained Chinese LLM Safety Guardrail with Scalable Data Construction and Model-aware Preference Alignment
Tsinghua University（清华大学）；Beijing Normal University（北京师范大学）；South China University of Technology（华南理工大学）；Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Shenzhen ShenNong Information Technology Co., Ltd.（深圳神农信息技术有限公司）
EnsemJudge: Enhancing Reliability in Chinese LLM-Generated Text Detection through Diverse Model Ensembles
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）
OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety
College of Intelligence and Computing, Tianjin University（天津大学智能与计算学部）；School of New Media and Communication, Tianjin University（天津大学新媒体与传播学院）；School of Computer and Artificial Intelligence, Zhengzhou University（郑州大学计算机与人工智能学院）
Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media
School of Software Engineering, Beijing University of Technology（北京工业大学软件学院）；School of Nursing, Wuhan University（武汉大学护理学院）；Sorbonne Université, Institut du Cerveau – Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière（索邦大学、巴黎脑研究所、法国国家科学研究中心、法国国家计算机与自动化研究所、法国国家健康与医学研究院、巴黎公立医院集团、皮蒂-萨尔皮特里耶医院）
McBE: A Multi-task Chinese Bias Evaluation Benchmark for Large Language Models
College of Computer Science, Inner Mongolia University（内蒙古大学计算机科学学院）；National & Local Joint Engineering Research Center of Intelligent Information Processing Technology for Mongolian（蒙古语智能信息处理技术国家与地方联合工程研究中心）；Inner Mongolia Key Laboratory of Multilingual Artificial Intelligence Technology（内蒙古多语种人工智能技术重点实验室）
LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports
Faculty of Data Science, City University of Macau（澳门城市大学数据科学学院）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Southern University of Science and Technology（南方科技大学）
Deep Learning and Large Language Models for Audio and Text Analysis in Predicting Suicidal Acts in Chinese Psychological Support Hotlines
School of Software Engineering, Beijing University of Technology（北京工业大学软件学院）；Beijing Suicide Research and Prevention Center, Beijing Huilongguan Hospital（北京回龙观医院北京自杀研究与预防中心）；WHO Collaborating Center for Research and Training in Suicide Prevention（世界卫生组织自杀预防研究与培训合作中心）；Peking University Huilongguan Clinical Medical School（北京大学回龙观临床医学院）；Sorbonne Université（索邦大学）；Institut du Cerveau - Paris Brain Institute - ICM（巴黎脑研究所（ICM））；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗集团）；Hôpital de la Pitié Salpêtrière（萨尔皮特里耶医院）
Developing a cardiovascular disease risk factor annotated corpus of Chinese electronic medical records
Language Technology Research Center, School of Computer Science and Technology, Harbin Institute of Technology（哈尔滨工业大学计算机科学与技术学院语言技术研究中心）；School of Software, Harbin University of Science and Technology（哈尔滨理工大学软件学院）
Evaluating Reliability Asymmetries in Chinese Factual Search and AI Answers
Department of Electronics, Information and Bioengineering, Politecnico di Milano（电子、信息与生物工程系，米兰理工学院）；University of Science and Technology of China（中国科学技术大学）
Deep Learning-Based Feature Fusion for Emotion Analysis and Suicide Risk Differentiation in Chinese Psychological Support Hotlines
School of Software Engineering, Beijing University of Technology（北京工业大学软件学院）；Peking University Huilongguan Clinical Medical School（北京大学回龙湖临床医学院）；Sorbonne Université（索邦大学）；Institut du Cerveau – Paris Brain Institute - ICM（巴黎脑研究所（ICM））；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗集团）；Hôpital de la Pitié-Salpêtrière（皮蒂-萨尔皮特里医院）
A Natural Language Processing Pipeline of Chinese Free-text Radiology Reports for Liver Cancer Diagnosis
School of Biomedical Engineering, Capital Medical University（首都医科大学生物医学工程学院）；Beijing Friendship Hospital, Capital Medical University（首都医科大学附属北京友谊医院）；Tsinghua University（清华大学）
Affective-ROPTester: Capability and Bias Analysis of LLMs in Predicting Retinopathy of Prematurity
College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院）；Department of Ophthalmology, Huizhou First Hospital（惠州市第一人民医院眼科部）；school of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）；School of Education, Shanghai Jiao Tong University（上海交通大学教育学院）；School of Computer Science, University of St Andrews（圣安德鲁大学计算机科学学院）；Shenzhen Eye Hospital, Shenzhen Eye Medical Center, Southern Medical University（深圳眼医院、深圳眼科医院、南方医科大学）
CEntRE: A paragraph-level Chinese dataset for Relation Extraction among Enterprises
University of Chinese Academy of Sciences（中国科学院大学）；Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；Henan University（河南大学）
FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarios
Shanghai University of Finance and Economics（上海财经大学）；Beihang University（北航）；Southern University of Science and Technology（南方科技大学）；MoE Key Laboratory of Interdisciplinary Research of Computation and Economics（计算与经济学交叉学科研究重点实验室）
New Terms, New Toxicity: Consensus-based Chinese Neologism Toxicity Detection via Search-Augmented LLMs
Tsinghua University（清华大学）；ICT, CAS（中国科学院计算技术研究所）；National Computer Network Emergency Response Technical Team Coordination Center of China（国家计算机网络应急技术处理协调中心）；IIE, CAS（中国科学院工程热物理研究所）；School of Cyber Security, UCAS（中国科学院大学网络空间安全学院）；JCSS, Tsinghua University（清华大学软件学院）；Science City (Guangzhou) Digital Technology Group Co., Ltd.（广州科学城数字科技集团有限公司）
MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs
Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100085, China（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049, China（中国科学院大学网络安全学院）
CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method
North China University of Technology（北方工业大学）；Beijing Key Laboratory of Key Technologies for AI+ Domain Applications（北京市AI+领域应用关键技术重点实验室）；Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data（大规模流数据集成与分析技术北京市重点实验室）
