Short text classification, as a research subtopic in natural language processing, is more challenging due to its semantic sparsity and insufficient labeled samples in practical scenarios. We propose a novel model named MI-DELIGHT for short text classification in this work. Specifically, it first performs multi-source information (i.e., statistical information, linguistic information, and factual information) exploration to alleviate the sparsity issues. Then, the graph learning approach is adopted to learn the representation of short texts, which are presented in graph forms. Moreover, we introduce a dual-level (i.e., instance-level and cluster-level) contrastive learning auxiliary task to effectively capture different-grained contrastive information within massive unlabeled data. Meanwhile, previous models merely perform the main task and auxiliary tasks in parallel, without considering the relationship among tasks. Therefore, we introduce a hierarchical architecture to explicitly model the correlations between tasks. We conduct extensive experiments across various benchmark datasets, demonstrating that MI-DELIGHT significantly surpasses previous competitive models. It even outperforms popular large language models on several datasets.
EpiCoDe: Boosting Model Performance Beyond Training with Extrapolation and Contrastive Decoding
Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所);Research Institute of China Telecom(中国电信研究 institute);School of Computer Science, Peking University(北京大学计算机科学学院);Beijing Institute of Big Data Research(北京大数据研究院);National Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI)
Boosting LLM Exploration via Weak-Model Guidance in RLVR
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);National Engineering Research Center of New Electronic Publishing Technologies(国家新型电子出版技术工程研究中心)
Boosting Adverse Drug Event Normalization on Social Media: General-Purpose Model Initialization and Biomedical Semantic Text Similarity Benefit Zero-Shot Linking in Informal Contexts
University of Ghent(根特大学);University of Udine(乌迪内大学)
Please refuse to answer me! Mitigating Over-Refusal in Large Language Models via Adaptive Contrastive Decoding
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学信息科学与技术学院深圳校区);School of Information, Central University of Finance and Economics(中央财经大学信息学院);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);School of Computing Technologies, RMIT University(皇家墨尔本理工大学计算技术学院)
Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE
Advanced Micro Devices, Inc.(超威半导体公司);Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University(西安交通大学人工智能与机器人研究所);University of HongKong(香港大学)
Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Models
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院)