基于多模态大语言模型的季节性广告主动检测与校准
Proactive Detection and Calibration of Seasonal Advertisements with Multimodal Large Language Models
AI总结:
本文提出PDCaSA季节性广告主动检测与校准研究问题,结合工业系统实践给出问题定义、评估指标等指引,采用多模态大语言模型实现检测,内部基准F1达0.97,并展望其在广告排序系统中的应用价值。
摘要:
大量因素会影响大规模广告投放系统,同时作用于用户体验与营收。其中一项因素便是季节性广告的主动检测与校准,该工作有助于提升转化率与用户满意度。本文提出了“季节性广告主动检测与校准(Proactive Detection and Calibration of Seasonal Advertisements, PDCaSA)”这一研究问题,该问题受到广告排序与推荐领域工业界与学术界的共同关注。本文从该问题的多个维度给出了详尽指引,这些指引均在大规模工业广告排序系统中经过验证,且源于该系统的实际需求。我们分享了相关研究发现,包括对问题的清晰界定、源于真实系统的研究动机、评估指标,同时阐明了当前存在的挑战、经验教训,以及解决该问题的数据标注与机器学习建模最佳实践。最后,我们介绍了本次研究探索中采用的最终解决方案:为检测季节性特征,我们利用了多模态大语言模型(Multimodal LLMs, MLMs),该模型在我们的内部基准测试中取得了0.97的最高F1值。基于研究结果,我们设想MLMs可作为知识蒸馏的教师模型、机器标注工具,以及集成式分层季节性检测系统的组成部分,从而为广告排序系统提供更丰富的季节性信息支撑。
英文摘要:
A myriad of factors affect large scale ads delivery systems and influence both user experience and revenue. One such factor is proactive detection and calibration of seasonal advertisements to help with increasing conversion and user satisfaction. In this paper, we present Proactive Detection and Calibration of Seasonal Advertisements (PDCaSA), a research problem that is of interest for the ads ranking and recommendation community, both in the industrial setting as well as in research. Our paper provides detailed guidelines from various angles of this problem tested in, and motivated by a large-scale industrial ads ranking system. We share our findings including the clear statement of the problem and its motivation rooted in real-world systems, evaluation metrics, and sheds lights to the existing challenges, lessons learned, and best practices of data annotation and machine learning modeling to tackle this problem. Lastly, we present a conclusive solution we took during this research exploration: to detect seasonality, we leveraged Multimodal LLMs (MLMs) which on our in-house benchmark achieved 0.97 top F1 score. Based on our findings, we envision MLMs as a teacher for knowledge distillation, a machine labeler, and a part of the ensembled and tiered seasonality detection system, which can empower ads ranking systems with enriched seasonal information.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。