Generative Input: Towards Next-Generation Input Methods Paradigm
University of Science and Technology of China(中国科学技术大学);State Key Laboratory of Cognitive Intelligence, iFLYTEK Research(认知智能国家重点实验室,科大讯飞研究院);iFLYTEK AI Research(科大讯飞人工智能研究院)
Since the release of ChatGPT, generative models have achieved tremendous success and become the de facto approach for various NLP tasks. However, its application in the field of input methods remains under-explored. Many neural network approaches have been applied to the construction of Chinese input method engines(IMEs).Previous research often assumed that the input pinyin was correct and focused on Pinyin-to-character(P2C) task, which significantly falls short of meeting users' demands. Moreover, previous research could not leverage user feedback to optimize the model and provide personalized results. In this study, we propose a novel Generative Input paradigm named GeneInput. It uses prompts to handle all input scenarios and other intelligent auxiliary input functions, optimizing the model with user feedback to deliver personalized results. The results demonstrate that we have achieved state-of-the-art performance for the first time in the Full-mode Key-sequence to Characters(FK2C) task. We propose a novel reward model training method that eliminates the need for additional manual annotations and the performance surpasses GPT-4 in tasks involving intelligent association and conversational assistance. Compared to traditional paradigms, GeneInput not only demonstrates superior performance but also exhibits enhanced robustness, scalability, and online learning capabilities.
MemAdapter: Fast Alignment across Agent Memory Paradigms via Generative Subgraph Retrieval
The University of Manchester(曼彻斯特大学);Stanford University(斯坦福大学);Imperial College London(伦敦帝国理工学院);National Institute of Advanced Industrial Science(国家先进工业科学与技术研究院)
A Survey of Generative Search and Recommendation in the Era of Large Language Models
The Hong Kong Polytechnic University(香港理工大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);Chinese Academy of Sciences(中国科学院);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
RecGPT: Generative Personalized Prompts for Sequential Recommendation via ChatGPT Training Paradigm
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Peking University(北京大学);Kuaishou Technology(快手科技);Unaffliated(无所属机构)
NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search
Gaoling School of Artificial Intelligence(光明人工智能学院);Renmin University of China(中国人民大学);University of Science and Technology of China(中国科学技术大学);CAS Key Laboratory of AI Safety(中国科学院人工智能安全重点实验室);Institute of Computing Technology(计算技术研究所);Chinese Academy of Sciences(中国科学院);National University of Singapore(新加坡国立大学)
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation
College of Computer Science, Chongqing University(重庆大学计算机学院);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS部门);Independent Researcher(独立研究员);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航空航天信息研究所);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系)
本文提出Masked History Learning框架,通过重建掩码的历史项目增强对用户行为的理解,从而提升推荐准确性。
NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction
Tencent(腾讯);National University of Singapore(新加坡国立大学);The Chinese University of Hong Kong(香港中文大学);Nanyang Technological University(南洋理工大学);Shenzhen University(深圳大学)
RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);NiuTrans Research(NiuTrans研究院);Institute of Psychology, CAS(中国科学院心理研究所);Kunming University of Science and Technology(昆明理工大学)