Low-quality or scarce data has posed significant challenges for training deep neural networks in practice. While classical data augmentation cannot contribute very different new data, diffusion models opens up a new door to build self-evolving AI by generating high-quality and diverse synthetic data through text-guided prompts. However, text-only guidance cannot control synthetic images' proximity to the original images, resulting in out-of-distribution data detrimental to the model performance. To overcome the limitation, we study image guidance to achieve a spectrum of interpolations between synthetic and real images. With stronger image guidance, the generated images are similar to the training data but hard to learn. While with weaker image guidance, the synthetic images will be easier for model but contribute to a larger distribution gap with the original data. The generated full spectrum of data enables us to build a novel "Diffusion Curriculum (DisCL)". DisCL adjusts the image guidance level of image synthesis for each training stage: It identifies and focuses on hard samples for the model and assesses the most effective guidance level of synthetic images to improve hard data learning. We apply DisCL to two challenging tasks: long-tail (LT) classification and learning from low-quality data. It focuses on lower-guidance images of high-quality to learn prototypical features as a warm-up of learning higher-guidance images that might be weak on diversity or quality. Extensive experiments showcase a gain of 2.7% and 2.1% in OOD and ID macro-accuracy when applying DisCL to iWildCam dataset. On ImageNet-LT, DisCL improves the base model's tail-class accuracy from 4.4% to 23.64% and leads to a 4.02% improvement in all-class accuracy.
Generalizable Synthetic Image Detection via Language-guided Contrastive Learning
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);State Key Laboratory of Internet of Things for Smart City(智慧城市物联网国家重点实验室);Department of Computer and Information Science, Faculty of Science and Technology, University of Macau(澳门大学计算机与信息科学系);Faculty of Applied Sciences, Macao Polytechnic University(澳门 polytechnic 大学应用科学系)
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing(测绘遥感信息工程国家重点实验室);Wuhan University(武汉大学);Information Systems Technology and Design Pillar(信息系统技术与设计学院);Singapore University of Technology and Design(新加坡科技与设计大学);School of Geodesy and Geomatics(测绘学院);School of Mathematics and Statistics(数学与统计学院);Wuhan University Shenzhen Research Institute(武汉大学深圳研究院)
CurEvo: Curriculum-Guided Self-Evolution for Video Understanding
Huazhong University of Science and Technology(华中科技大学);La Trobe University(拉特罗布大学);Beijing Institute of Computer Technology and Applications(北京计算机技术与应用研究院)
CurriFlow: Curriculum-Guided Depth Fusion with Optical Flow-Based Temporal Alignment for 3D Semantic Scene Completion
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Ministry of Education(教育部);Shandong Computer Science Center (National Supercomputer Center in Jinan)(山东省计算机科学中心(济南国家超算中心));Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing(山东省计算电力互联网与服务计算重点实验室);Shandong Fundamental Research Center for Computer Science(山东省计算机科学基础研究中心)
FANCL: Feature-Guided Attention Network with Curriculum Learning for Brain Metastases Segmentation
Digital Medical Research Center, School of Basic Medical Science, Fudan University(复旦大学基础医学院数字医学研究中心);Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention(上海市医学影像计算与计算机辅助介入重点实验室)
Prototype-Guided Curriculum Learning for Zero-Shot Learning
School of Electronic Information and Communications, Huazhong University of Science and Technology(电子信息与通信学院,华中科技大学);Mohamed bin Zayed University of AI(马尔代夫人工智能大学);School of Computer Science and Engineering, Nanjing University of Science and Technology(计算机科学与工程学院,南京理工大学);School of Computer Science, The University of Sydney(计算机科学学院,悉尼大学)
Curriculum-guided Change Detection Training: Toward Accurate Serac Fall Monitoring
LIRIS, UMR5205, Université Lumière Lyon 2, CNRS, Ecole Centrale de Lyon, INSA Lyon, Université Claude Bernard Lyon 1(LIRIS实验室,UMR5205,里昂第二大学,法国国家科学研究中心,里昂中央理工学院,INSA里昂,克洛德·贝尔纳里昂第一大学);Styx4D(Styx4D公司)
CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Automation, Nanjing University of Science and Technology(南京理工大学自动化学院)
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
School of Computer Science, Peking University, Beijing, China(北京大学计算机科学系);Center for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2113, Australia(健康信息学中心,澳大利亚健康创新研究所,麦考利大学,悉尼,NSW 2113,澳大利亚);School of Data Science, University of Virginia, Charlottesville, VA, USA(数据科学学院,弗吉尼亚大学,夏洛特维尔,VA,美国)
Shenzhen University of Advanced Technology(深圳先进技术大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Xi’an Jiaotong University(西安交通大学)
DCL-SE: Dynamic Curriculum Learning for Spatiotemporal Encoding of Brain Imaging
University of Chinese Academy of Sciences(中国科学院大学);Capital Medical University(首都医科大学);Beijing Tongren Hospital(北京同仁医院);Beijing Institute of Ophthalmology(北京眼科研究所);Wannan Medical University(皖南医学院)
CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院健康科学与技术学院);Shanghai Innovation Institute(上海创新研究院);Clinical Center for Sports Medicine, Department of Orthopaedics, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院骨科临床中心);School of Basic Medical Sciences, Intelligent Medicine Institute, Fudan University(复旦大学基础医学学院);Department of Hematology, The First Affiliated Hospital, College of Medicine, Zhejiang University(浙江大学医学院第一附属医院血液科);MoE Key Laboratory of Brain-Inspired Intelligent Perception and Cognition, University of Science and Technology of China(中国科学技术大学脑启发智能感知与认知教育部重点实验室);Department of Public Health and Primary Care, University of Cambridge(剑桥大学公共卫生与初级保健学院);Department of Medicine, Faculty of Health Sciences, Universidad CEU Cardenal Herrera(CEU卡德纳尔-赫尔曼大学健康科学学院医学系);Faculty of Medicine, University of Helsinki(赫尔辛基大学医学院);X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院X-LANCE实验室);Department of Hepatobiliary Surgery, National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院肿瘤医院肝胆外科);Department of Surgery, The Ohio State University Wexner Medical Center, The James Comprehensive Cancer Center(俄亥俄州立大学韦克斯纳医学中心外科部,詹姆斯综合癌症中心);Ningbo Institute of Technology, Beihang University(北航宁波理工学院)