E-commerce platforms generate vast amounts of customer behavior data, such as clicks and purchases, from millions of unique users every day. However, effectively using this data for behavior understanding tasks is challenging because there are usually not enough labels to learn from all users in a supervised manner. This paper extends the BERT model to e-commerce user data for pre-training representations in a self-supervised manner. By viewing user actions in sequences as analogous to words in sentences, we extend the existing BERT model to user behavior data. Further, our model adopts a unified structure to simultaneously learn from long-term and short-term user behavior, as well as user attributes. We propose methods for the tokenization of different types of user behavior sequences, the generation of input representation vectors, and a novel pretext task to enable the pre-trained model to learn from its own input, eliminating the need for labeled training data. Extensive experiments demonstrate that the learned representations result in significant improvements when transferred to three different real-world tasks, particularly compared to task-specific modeling and multi-task representation learning
Learning Preference-Based Objectives from Clinical Narratives for Dynamic Sepsis Treatment
Institute of Data Science, National University of Singapore, Singapore(新加坡国立大学数据科学研究所);National University Hospital, Singapore(新加坡国立大学医院);Saw Swee Hock School of Public Health, National University of Singapore, Singapore(新加坡国立大学 Saw Swee Hock 公共卫生学院)
Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models
National Key Laboratory of Parallel and Distributed Processing(平行与分布式处理国家重点实验室);College of Computer Science and Technology(计算机科学与技术学院);National University of DefenseTechnology(国防科技大学);DP Technology(DP科技)
Online Self-Calibration Against Hallucination in Vision-Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Differential-Critic GAN: Generating What You Want by a Cue of Preferences
Southern University of Science and Technology(南方科技大学);Australian Artificial Intelligence Institute, University of Technology Sydney(悉尼科技大学澳大利亚人工智能研究所);A*STAR Center for Frontier AI Research(新加坡科技研究局前沿人工智能研究中心);Research Institute of Trustworthy Autonomous Systems(可信自主系统研究院);University of Birmingham(伯明翰大学)
Enhancing Reinforcement Learning for Radiology Report Generation with Evidence-aware Rewards and Self-correcting Preference Learning
Department of Computer Science and Engineering, ECUST(电子科技大学计算机科学与工程系);Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, P. R. China(教育部能源化工过程智能制造重点实验室);Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院)