Modern media firms require automated and efficient methods to identify content that is most engaging and appealing to users. Leveraging a large-scale dataset from Upworthy (a news publisher), which includes 17,681 headline A/B tests, we first investigate the ability of three pure-LLM approaches to identify the catchiest headline: prompt-based methods, embedding-based methods, and fine-tuned open-source LLMs. Prompt-based approaches perform poorly, while both OpenAI-embedding-based models and the fine-tuned Llama-3-8B achieve marginally higher accuracy than random predictions. In sum, none of the pure-LLM-based methods can predict the best-performing headline with high accuracy. We then introduce the LLM-Assisted Online Learning Algorithm (LOLA), a novel framework that integrates Large Language Models (LLMs) with adaptive experimentation to optimize content delivery. LOLA combines the best pure-LLM approach with the Upper Confidence Bound algorithm to allocate traffic and maximize clicks adaptively. Our numerical experiments on Upworthy data show that LOLA outperforms the standard A/B test method (the current status quo at Upworthy), pure bandit algorithms, and pure-LLM approaches, particularly in scenarios with limited experimental traffic. Our approach is scalable and applicable to content experiments across various settings where firms seek to optimize user engagement, including digital advertising and social media recommendations.
Exploring Deep Reinforcement Learning-Assisted Federated Learning for Online Resource Allocation in Privacy-Persevering EdgeIoT
Real-Time and Embedded Computing Systems Research Centre (CISTER)(实时与嵌入式计算系统研究中心);TU Delft(代尔夫特理工大学);Commonwealth Scientific and Industrial Research Organisation (CSIRO)(联邦科学与工业研究组织);Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学)
Efficient Beam Selection for ISAC in Cell-Free Massive MIMO via Digital Twin-Assisted Deep Reinforcement Learning
National Mobile Communications Research Laboratory, Frontiers Science Center for Mobile Information Communication and Security, Southeast University(国家移动通信研究中心,移动信息通信与安全前沿科学中心,东南大学);Pervasive Communications Center, Purple Mountain Laboratories(普适通信中心,紫金山实验室);School of Electronic and Optical Engineering, Nanjing University of Science and Technology(电子与光学工程学院,南京理工大学)
Online Regime-aware Calibration for Black-box Social Simulators via Posterior-assisted Evolutionary Dynamic Optimization
Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen 518055, China(脑启发智能计算广东省重点实验室,南方科技大学,深圳518055,中国);Department of Computer Science and Engineering(计算机科学与工程系);Department of Statistics and Data Science(统计与数据科学系);Zhongguancun Academy, Beijing 100094, China(中关村学院,北京100094,中国);School of Data Science, Lingnan University, Hong Kong SAR, China(数据科学学院,岭南大学,香港特别行政区,中国)