大模型对齐与安全

Captioning for Text-Video Retrieval via Dual-Group Direct Preference Optimization

Ji Soo Lee, Byungoh Ko, Jaewon Cho, Howoong Lee, Jaewoon Byun, Hyunwoo J. Kim

机构 * Korea University（韩国大学） ； Hanwha Vision（翰威英航） ； KAIST（韩国科学技术院） 纠错

专题命中 偏好对齐 ：DPO(abstract)

Comments EMNLP 2025 Findings

BaseReward: A Strong Baseline for Multimodal Reward Model

Yi-Fan Zhang, Haihua Yang, Huanyu Zhang, Yang Shi, Zezhou Chen, Haochen Tian, Chaoyou Fu, Haotian Wang, Kai Wu, Bo Cui, Xu Wang, Jianfei Pan, Haotian Wang, Zhang Zhang, Liang Wang

机构 * ByteDance（字节跳动） ； CASIA（中国科学院自动化研究所） ； NJU（南京大学） ； PKU（北京大学） ； THU（清华大学） 纠错

专题命中 偏好对齐 ：RLHF(abstract)

Towards personalized, precise and survey-free environment recognition: AI-enhanced sensor fusion without pre-deployment

Ruichen Wang, Zhikang Ni, Pengzhou Wang, Xiya Cao, Zhi Li, Bao Zhang

专题命中 偏好对齐 ：RLHF(abstract)

Comments 5 pages, 7 figures, conference

Enhancing LLM-Based Social Bot via an Adversarial Learning Framework

Fanqi Kong, Xiaoyuan Zhang, Xinyu Chen, Yaodong Yang, Song-Chun Zhu, Xue Feng

专题命中 偏好对齐 ：DPO(abstract)

InstructMPC: A Human-LLM-in-the-Loop Framework for Context-Aware Control

Ruixiang Wu, Jiahao Ai, Tongxin Li

专题命中 偏好对齐 ：DPO(abstract)

Improving Large Vision and Language Models by Learning from a Panel of Peers

Jefferson Hernandez, Jing Shi, Simon Jenni, Vicente Ordonez, Kushal Kafle

机构 * Rice University（里士大学） ； Adobe Research（Adobe研究） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments Accepted at ICCV 2025

FantasyHSI: Video-Generation-Centric 4D Human Synthesis In Any Scene through A Graph-based Multi-Agent Framework

Lingzhou Mu, Qiang Wang, Fan Jiang, Mengchao Wang, Yaqi Fan, Mu Xu, Kai Zhang

专题命中 偏好对齐 ：DPO(abstract)

Comments https://fantasy-amap.github.io/fantasy-hsi/

Refining Text Generation for Realistic Conversational Recommendation via Direct Preference Optimization

Manato Tajiri, Michimasa Inaba

专题命中 偏好对齐 ：DPO(abstract)

Comments Accepted to EMNLP 2025 Main Conference

HPSv3: Towards Wide-Spectrum Human Preference Score

Yuhang Ma, Yunhao Shui, Xiaoshi Wu, Keqiang Sun, Hongsheng Li

机构 * Mizzen AI ； CUHK MMLab（香港大学MMLab） ； King’s College London（伦敦国王学院） ； Shanghai Jiaotong University（上海交通大学） ； Shanghai AI Laboratory（上海人工智能实验室） ； CPII, InnoHK（创新香港科技促进会） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments ICCV2025

QueryGenie: Making LLM-Based Database Querying Transparent and Controllable

Longfei Chen, Shenghan Gao, Shiwei Wang, Ken Lin, Yun Wang, Quan Li

专题命中 偏好对齐 ：alignment(abstract)

Comments Accepted by The 38th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct '25), September 28-October 1, 2025, Busan, Republic of Korea

3D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding

Ting Huang, Zeyu Zhang, Hao Tang

专题命中 偏好对齐 ：RLHF(abstract)

TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation

Yuheng Feng, Jianhui Wang, Kun Li, Sida Li, Tianyu Shi, Haoyue Han, Miao Zhang, Xueqian Wang

机构 * organization= Xidian University , addressline= No. 2 Taibai South Road , city= Xi'an , postcode= 710071 , state= Shaanxi , country= China ； organization= Xiamen University Malaysia , addressline= Jalan Sunsuria, Bandar Sunsuria , city= Sepang , postcode= 43900 , state= Selangor , country= Malaysia ； organization= Peking University , addressline= 5 Yiheyuan Road, Haidian District , city= Beijing , postcode= 100871 , state= Beijing , country= China ； organization= Faculty of Applied Science \& Engineering, University of Toronto , addressline= 27 King's College Cir , city= Toronto , postcode= M5S 1A1 , state= Ontario , country= Canada ； organization= Shenzhen International Graduate School, Tsinghua University , addressline= University Town of Shenzhen, Nanshan District , city= Shenzhen , postcode= 518055 , state= Guangdong , country= China 纠错

专题命中 偏好对齐 ：alignment(abstract)

OMR-Diffusion:Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Intent Understanding

Kun Li, Jianhui Wang, Miao Zhang, Xueqian Wang

机构 * Xiamen University（厦门大学） ； University of Electronic Science and Technology of China（电子科技大学） ； Shenzhen International Graduate School, Tsinghua University（深圳国际研究生院，清华大学） ； Xidian University（西安电子科技大学） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Seedream 3.0 Technical Report

Yu Gao, Lixue Gong, Qiushan Guo, Xiaoxia Hou, Zhichao Lai, Fanshi Li, Liang Li, Xiaochen Lian, Chao Liao, Liyang Liu, Wei Liu, Yichun Shi, Shiqi Sun, Yu Tian, Zhi Tian, Peng Wang, Rui Wang, Xuanda Wang, Xun Wang, Ye Wang, Guofeng Wu, Jie Wu, Xin Xia, Xuefeng Xiao, Zhonghua Zhai, Xinyu Zhang, Qi Zhang, Yuwei Zhang, Shijia Zhao, Jianchao Yang, Weilin Huang

机构 * ByteDance（字节跳动） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments Seedream 3.0 Technical Report

Aligning Anime Video Generation with Human Feedback

Bingwen Zhu, Yudong Jiang, Baohan Xu, Siqian Yang, Mingyu Yin, Yidi Wu, Huyang Sun, Zuxuan Wu

机构 * Fudan University（复旦大学） ； Bilibili Inc（哔哩哔哩公司） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments 10 pages, 7 figures, 7 tables

CODS : A Theoretical Model for Computational Design Based on Design Space

Nan Cao, Xiaoyu Qi, Chuer Chen, Xiaoke Yan

专题命中 偏好对齐 ：alignment(abstract)

Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoning

Xiaokun Wang, Peiyu Wang, Jiangbo Pei, Wei Shen, Yi Peng, Yunzhuo Hao, Weijie Qiu, Ai Jian, Tianyidan Xie, Xuchen Song, Yang Liu, Yahui Zhou

机构 * Skywork AI（Skywork人工智能公司） ； Kunlun Inc.（昆仑公司） 纠错

专题命中 偏好对齐 ：alignment(abstract)

CHATS: Combining Human-Aligned Optimization and Test-Time Sampling for Text-to-Image Generation

Minghao Fu, Guo-Hua Wang, Liangfu Cao, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang

机构 * National Key Laboratory for Novel Software Technology, Nanjing University（新型软件技术国家实验室，南京大学） ； School of Artificial Intelligence, Nanjing University（人工智能学院，南京大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments ICML 2025. The code is publicly available at https://github.com/AIDC-AI/CHATS

K-order Ranking Preference Optimization for Large Language Models

Shihao Cai, Chongming Gao, Yang Zhang, Wentao Shi, Jizhi Zhang, Keqin Bao, Qifan Wang, Fuli Feng

专题命中 偏好对齐 ：DPO(abstract)

Profiling and optimization of multi-card GPU machine learning jobs

Marcin Lawenda, Kyrylo Khloponin, Krzesimir Samborski, Łukasz Szustak

专题命中 偏好对齐 ：DPO(abstract)

Comments 27 pages, 28 figures. arXiv admin note: substantial text overlap with arXiv:2503.15252

Zooming from Context to Cue: Hierarchical Preference Optimization for Multi-Image MLLMs

Xudong Li, Mengdan Zhang, Peixian Chen, Xiawu Zheng, Yan Zhang, Jingyuan Zheng, Yunhang Shen, Ke Li, Chaoyou Fu, Xing Sun, Rongrong Ji

机构 * Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University（中国教育部多媒体可信感知与高效计算重点实验室，厦门大学） ； Tencent Youtu Lab（腾讯优图实验室） ； Nanjing University（南京大学） 纠错

专题命中 偏好对齐 ：DPO(abstract)

Aligning Web Query Generation with Ranking Objectives via Direct Preference Optimization

João Coelho, Bruno Martins, João Magalhães, Chenyan Xiong

专题命中 偏好对齐 ：DPO(abstract)

Comments Accepted at SIGIR 2025

ReCopilot: Reverse Engineering Copilot in Binary Analysis

Guoqiang Chen, Huiqi Sun, Daguang Liu, Zhiqi Wang, Qiang Wang, Bin Yin, Lu Liu, Lingyun Ying

专题命中 偏好对齐 ：DPO(abstract)

Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy

Zihao Feng, Xiaoxue Wang, Bowen Wu, Weihong Zhong, Zhen Xu, Hailong Cao, Tiejun Zhao, Ying Li, Baoxun Wang

专题命中 偏好对齐 ：DPO(abstract)

Learning to Reason and Navigate: Parameter Efficient Action Planning with Large Language Models

Bahram Mohammadi, Ehsan Abbasnejad, Yuankai Qi, Qi Wu, Anton Van Den Hengel, Javen Qinfeng Shi

专题命中 偏好对齐 ：DPO(abstract)

Do Language Model Agents Align with Humans in Rating Visualizations? An Empirical Study

Zekai Shao, Yi Shan, Yixuan He, Yuxuan Yao, Junhong Wang, Xiaolong, Zhang, Yu Zhang, Siming Chen

专题命中 偏好对齐 ：alignment(abstract)

Comments 14 pages, 8 figures

Distribution-Conditional Generation: From Class Distribution to Creative Generation

Fu Feng, Yucheng Xie, Xu Yang, Jing Wang, Xin Geng

机构 * School of Computer Science and Engineering, Southeast University, Nanjing, China（计算机科学与工程学院，东南大学，南京，中国） ； Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China（新一代人工智能技术及其跨学科应用重点实验室（东南大学），教育部，中国） 纠错

专题命中 偏好对齐 ：alignment(abstract)

MM-IFEngine: Towards Multimodal Instruction Following

Shengyuan Ding, Shenxi Wu, Xiangyu Zhao, Yuhang Zang, Haodong Duan, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Dahua Lin, Jiaqi Wang

机构 * Fudan University（复旦大学） ； Shanghai AI Laboratory（上海人工智能实验室） ； Shanghai Jiaotong University（上海交通大学） ； The Chinese University of Hong Kong（香港中文大学） ； CPII under InnoHK（创新香港下的CPII） ； Shanghai Innovation Institute（上海创新研究院） 纠错

专题命中 偏好对齐 ：DPO(abstract)

Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding

Kun Li, Jianhui Wang, Yangfan He, Xinyuan Song, Ruoyu Wang, Hongyang He, Wenxin Zhang, Jiaqi Chen, Keqin Li, Sida Li, Miao Zhang, Tianyu Shi, Xueqian Wang

机构 * Xiamen University（厦门大学） ； University of Electronic Science and Technology of China（电子科技大学） ； University of Minnesota—Twin Cities（明尼苏达大学—双城分校） ； Emory University（埃默里大学） ； Tsinghua University（清华大学） ； University of Warwick（沃里克大学） ； University of the Chinese Academy of Sciences（中国科学院大学） ； George Washington University（乔治华盛顿大学） ； University of Toronto（多伦多大学） ； Peking University（北京大学） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments arXiv admin note: substantial text overlap with arXiv:2503.17660

InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

Jinguo Zhu, Weiyun Wang, Zhe Chen, Zhaoyang Liu, Shenglong Ye, Lixin Gu, Hao Tian, Yuchen Duan, Weijie Su, Jie Shao, Zhangwei Gao, Erfei Cui, Xuehui Wang, Yue Cao, Yangzhou Liu, Xingguang Wei, Hongjie Zhang, Haomin Wang, Weiye Xu, Hao Li, Jiahao Wang, Nianchen Deng, Songze Li, Yinan He, Tan Jiang, Jiapeng Luo, Yi Wang, Conghui He, Botian Shi, Xingcheng Zhang, Wenqi Shao, Junjun He, Yingtong Xiong, Wenwen Qu, Peng Sun, Penglong Jiao, Han Lv, Lijun Wu, Kaipeng Zhang, Huipeng Deng, Jiaye Ge, Kai Chen, Limin Wang, Min Dou, Lewei Lu, Xizhou Zhu, Tong Lu, Dahua Lin, Yu Qiao, Jifeng Dai, Wenhai Wang

机构 * Shanghai AI Laboratory（上海人工智能实验室） ； SenseTime Research（商汤科技研究院） ； Tsinghua University（清华大学） ； Nanjing University（南京大学） ； Fudan University（复旦大学） ； The Chinese University of Hong Kong（香港中文大学） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 偏好对齐 ：alignment(abstract)

Comments Technical Report