The ability of large language models (LLMs) to execute complex instructions is essential for their real-world applications. However, several recent studies indicate that LLMs struggle with challenging instructions. In this paper, we propose Evolutionary Contrastive Distillation (ECD), a novel method for generating high-quality synthetic preference data designed to enhance the complex instruction-following capability of language models. ECD generates data that specifically illustrates the difference between a response that successfully follows a set of complex instructions and a response that is high-quality, but nevertheless makes some subtle mistakes. This is done by prompting LLMs to progressively evolve simple instructions to more complex instructions. When the complexity of an instruction is increased, the original successful response to the original instruction becomes a "hard negative" response for the new instruction, mostly meeting requirements of the new instruction, but barely missing one or two. By pairing a good response with such a hard negative response, and employing contrastive learning algorithms such as DPO, we improve language models' ability to follow complex instructions. Empirically, we observe that our method yields a 7B model that exceeds the complex instruction-following performance of current SOTA 7B models and is competitive even with open-source 70B models.
Multi-view Contrastive Learning for Online Knowledge Distillation
Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS)(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Xiamen Data Intelligence Academy of ICT, CAS(中国科学院计算技术研究所厦门数据智能研究院)
Enriching Knowledge Distillation with Intra-Class Contrastive Learning
Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其跨学科应用重点实验室(东南大学),教育部,中国)
针对知识蒸馏中教师软标签缺乏类内多样表示的问题,本文提出带 margin loss 的类内对比学习教师训练方法,并通过理论与实验验证其有效性。
Preview-based Category Contrastive Learning for Knowledge Distillation
School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院);School of Software, Shandong University(山东大学软件学院);Alibaba Group(阿里巴巴集团)
PACD-Net: Pseudo-Augmented Contrastive Distillation for Glycemic Control Estimation from SMBG
University of Virginia, School of Data Science, Charlottesville, VA 22903, USA(弗吉尼亚大学数据科学学院);University of Virginia, Department of Pediatrics, Charlottesville, VA 22903, USA(弗吉尼亚大学儿科系)
Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
Beihang University(北京航空航天大学);Beijing Institute of Technology(北京理工大学);Independent Researcher(独立研究者);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Edinburgh(爱丁堡大学)
COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training
Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Helmholtz Munich(亥姆霍兹慕尼黑中心);Munich Data Science Institute (MDSI)(慕尼黑数据科学研究所)
Contrastive Knowledge Transfer and Robust Optimization for Secure Alignment of Large Language Models
Northwestern University(西北大学);Syracuse University(雪城大学);Trine University(特里恩大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Carnegie Mellon University(卡内基梅隆大学)
Seeing in the Dark: A Teacher-Student Framework for Dark Video Action Recognition via Knowledge Distillation and Contrastive Learning
School of Information Technology, Monash University, Malaysia;Faculty of Information Technology, Monash University, Australia;Robotics \& Autonomous Systems Lab, TCS Research, India;Dept of Electrical Engineering, University of Malaya, Malaysia
Carnegie Mellon University(卡内基梅隆大学);Sun Yat-sen University(中山大学);University of Cambridge(剑桥大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Sea AI Lab(Sea人工智能实验室);Mila-Québec AI Institute(米拉-魁北克人工智能研究所);HEC Montréal(蒙特利尔高等商学院)
Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation
Lab of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China(教育人工智能实验室,华东师范大学,上海200062,中国);Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China(教育人工智能研究所,华东师范大学,上海200062,中国);School of Computer Science and Technology, East China Normal University, Shanghai 200062, China(计算机科学与技术学院,华东师范大学,上海200062,中国)
Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation
ZJU-UIUC Joint Institute at Zhejiang University(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所);ZJU-UoE Institute at Zhejiang University(浙江大学-爱丁堡大学联合研究所);College of Biomedical Engineering and Instrument Science at Zhejiang University(浙江大学生物医学工程与仪器科学学院);College of Computer Science and Technology in Zhejiang University(浙江大学计算机科学与技术学院)
Contrastive Model Inversion for Data-Free Knowledge Distillation
Zhejiang University(浙江大学);Alibaba-Zhejiang University Joint Research Institute of Frontier Technologies(浙江大学-阿里巴巴前沿技术联合研究中心);National University of Singapore(新加坡国立大学)
Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Baidu Inc.(百度公司);School of Cyber Security at University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Department of Communication Engineering, Shanghai University(上海大学通信工程系)
Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation
Sun Yat-sen University(中山大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)
Student Network Learning via Evolutionary Knowledge Distillation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Department of Communication Engineering, Shanghai University(上海大学通信工程学院)