EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing
Shanghai Jiao Tong University(上海交通大学);Vivo Mobile Communication Co., Ltd(vivo移动通信有限公司);University of Electronic and Science Technology of China(电子科技大学);Ocean University of China(海洋大学);Beijing University of Technology(北京理工大学)
Zitong Xu, Huiyu Duan, Zhongpeng Ji, Xinyun Zhang, Yutao Liu, Xiongkuo Min, Ke Gu, Jian Zhang, Shusong Xu, Jinwei Chen, Bo Li, Guangtao Zhai
Recent text-guided image editing (TIE) models have achieved remarkable progress, while many edited images still suffer from issues such as artifacts, unexpected editings, unaesthetic contents. Although some benchmarks and methods have been proposed for evaluating edited images, scalable evaluation models are still lacking, which limits the development of human feedback reward models for image editing. To address the challenges, we first introduce \textbf{EditHF-1M}, a million-scale image editing dataset with over 29M human preference pairs and 148K human mean opinion ratings, both evaluated from three dimensions, \textit{i.e.}, visual quality, instruction alignment, and attribute preservation. Based on EditHF-1M, we propose \textbf{EditHF}, a multimodal large language model (MLLM) based evaluation model, to provide human-aligned feedback from image editing. Finally, we introduce \textbf{EditHF-Reward}, which utilizes EditHF as the reward signal to optimize the text-guided image editing models through reinforcement learning. Extensive experiments show that EditHF achieves superior alignment with human preferences and demonstrates strong generalization on other datasets. Furthermore, we fine-tune the Qwen-Image-Edit using EditHF-Reward, achieving significant performance improvements, which demonstrates the ability of EditHF to serve as a reward model to scale-up the image editing. Both the dataset and code will be released in our GitHub repository: https://github.com/IntMeGroup/EditHF.
RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing
Institute of Artificial Intelligence, China Telecom (TeleAI)(中国电信人工智能研究院(TeleAI));The Chinese University of Hong Kong (CUHK)(香港中文大学);Sun Yat-sen University(中山大学);Fudan University(复旦大学);Tsinghua University(清华大学)
Señorita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialists
The Chinese University of Hong Kong(香港中文大学);The Hong Kong Polytechnic University(香港理工大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);IntelliFusion Inc.(智融公司);University of Electronic Science and Technology of China(电子科技大学)
ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motions
ByteDance Seed(字节跳动种子);University of Southern California(南加州大学);University of Tokyo(东京大学);University of California Berkeley(加州大学伯克利分校);Stanford University(斯坦福大学);University of California Los Angeles(加州大学洛杉矶分校)
Factuality Matters: When Image Generation and Editing Meet Structured Visuals
CUHK MMLab(香港大学多模态实验室);Beihang University(北京航空航天大学);Krea AI(Krea人工智能);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Lab(上海人工智能实验室);Hugging Face;National University of Singapore(新加坡国立大学);ByteDance(字节跳动);The University of Hong Kong(香港大学)
University of Sydney(悉尼大学);Microsoft Research(微软研究院);Fudan University(复旦大学);Nankai University(南开大学);Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);University of Waterloo(滑铁卢大学)
SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localization
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Guangdong Provincial Key Laboratory of Intelligent Information Processing and Shenzhen Key Laboratory of Media Security(广东省智能信息处理重点实验室和深圳媒体安全重点实验室);Shenzhen University of Advanced Technology and Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术大学和深圳先进技术研究所,中国科学院);Alibaba Group(阿里巴巴集团);Shenzhen MSU-BIT University(深圳MSU-BIT大学)
FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
University of Electronic Science and Technology of China(电子科技大学);Central South University(中南大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);Microsoft(微软)
DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing
Shanghai Jiao Tong University(上海交通大学);South China University of Technology(华南理工大学);Xiamen University(厦门大学);University of Science and Technology of China(中国科学技术大学)
The CLIP Model is Secretly an Image-to-Prompt Converter
Xidian University(西安电子科技大学);Northwestern Polytechnical University(西北工业大学);The University of Adelaide(阿德莱德大学);Australian Institute for Machine Learning(澳大利亚机器学习研究院)
Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Model
Beihang University(北京航空航天大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shen Yuan Honors College of Beihang University(北京航空航天大学沈元荣誉学院);National University of Singapore(新加坡国立大学)
Revisiting Image Aesthetic Assessment via Self-Supervised Feature Learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Youtu Lab, Tencent(腾讯优图实验室);Snap Inc.(Snap公司);North China Electric Power University(华北电力大学);Xiamen University(厦门大学);Kuaishou Technology(快手科技)