Scale over Preference: The Impact of AI-Generated Content on Online Content Ecology
University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);Kuaishou Technology(快手科技);The Chinese University of Hong Kong(香港中文大学)
Tianhao Shi, Yang Zhang, Xiaoyan Zhao, Fengbin Zhu, Chenyi Lei, Han Li, Wenwu Ou, Tian Yang, Yang Song, Yongdong Zhang, Fuli Feng
The rapid proliferation of Artificial Intelligence-Generated Content (AIGC) is fundamentally restructuring online content ecologies, necessitating a rigorous examination of its behavioral and distributional implications. Leveraging a comprehensive longitudinal dataset comprising tens of millions of users from a leading Chinese video-sharing platform, this study elucidated the distinct creation and consumption behaviors characterizing AIGC versus Human-Generated Content (HGC). We identified a prevalent scale-over-preference dynamic, wherein AIGC creators achieve aggregate engagement comparable to HGC creators through high-volume production, despite a marked consumer preference for HGC. Deeper analysis uncovered the ability of the algorithmic content distribution mechanism in moderating these competing interests regarding AIGC. These findings advocated for the implementation of AIGC-sensitive distribution algorithms and precise governance frameworks to ensure the long-term health of the online content platforms.
Align Generative Artificial Intelligence with Human Preferences: A Novel Large Language Model Fine-Tuning Method for Online Review Management
Department of Information Systems and Operations Management, The University of Texas at Arlington(信息系统与运营管理系,德克萨斯大学阿灵顿分校);Department of Management Information Systems, University of Arizona(管理信息学系,亚利桑那大学)
T-POP: Test-Time Personalization with Online Preference Feedback
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));East China Normal University(华东师范大学);Shenzhen Loop Area Institute(深圳河套学院);Tianjin University(天津大学);The Chinese University of Hong Kong(香港中文大学);Beihang University(北京航空航天大学);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州))
Alignment through Meta-Weighted Online Sampling: Bridging the Gap between Data Generation and Preference Optimization
School of Computer Science and Engineering, Southeast University, Nanjing, China(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其交叉应用国家重点实验室)
How Much Online RL is Enough? Informative Rollouts for Offline Preference Optimization in RLVR
TCS Research Department of CSE(TCS计算机科学系研究部);IIT Madras(印度理工学院马德拉斯分校);Department of Data Science & AI(数据科学与人工智能系);Wadhwani School of Data Science & AI(Wadhwani数据科学与人工智能学院)
Learning Preferences for Manipulation Tasks from Online Coactive Feedback
Cornell University(康奈尔大学)
我们考虑的问题,学习偏好的轨迹移动机械手,如个人机器人和装配线机器人。我们学习的偏好比简单的轨迹几何约束更复杂;它们受到各种物体的周围环境和环境中人类交互的影响。我们提出了一个互动的在线学习框架,在上下文丰富的环境中的教学偏好。我们方法的关键新颖性在于期望用户提供的反馈类型:人类用户不需要将最佳轨迹作为训练数据进行演示,而只需要迭代提供比系统当前提出的轨迹略有改进的轨迹。我们认为,这种互动偏好反馈可以更容易地引起比示范的最佳轨迹。尽管如此,我们的算法的理论遗憾界匹配的最优轨迹算法的渐近速度。我们实现我们的算法上的两个高自由度的机器人,PR 2和巴克斯特,并提出了三个直观的机制,提供这样的增量反馈。在我们的实验评估中,我们考虑了两个背景丰富的设置-家务和杂货店结帐-并表明用户能够训练机器人只有几个反馈(只需要几分钟)。\footnote{Parts of this work has been published at NIPS and ISRR conferences~\citep{Jain13,Jain13b}. This journal submission presents a consistent full paper, and also includes the proof of regret bounds, more details of the robotic syst…
Avoiding $\mathbf{exp(R_{max})}$ scaling in RLHF through Preference-based Exploration
Department of Electrical & Computer Engineering(电气与计算机工程系);Boston University(波士顿大学);Department of Computer Science(计算机科学系);Cornell University(康奈尔大学);Faculty of Computing & Data Sciences(计算与数据科学学院)
LEASE: Offline Preference-based Reinforcement Learning with High Sample Efficiency
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);CASIA-MUST Joint Laboratory of Intelligence Science and Technology, Institute of Systems Engineering, Macau University of Science and Technology(智能科学与技术CASIA-MUST联合实验室,澳门科学理工学院)
Towards Efficient Online Exploration for Reinforcement Learning with Human Feedback
Department of Statistics and Data Science, The Chinese University of Hong Kong(统计与数据科学系,香港中文大学);Department of Statistics, University of Wisconsin-Madison(统计系,威斯康星大学麦迪逊分校)
CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendation
School of Computer Science and Technology, Donghua University(东华大学计算机科学与技术学院);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(华东师范大学上海人工智能教育研究院)