arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.00969cs.CL
收藏

使用 RL 识别分歧观点提升 LLM 识别社交媒体社区的能力

Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Media

Purdue University(普渡大学)

Nikhil Mehta, Dan Goldwasser

AI总结:

提出通过训练较小 LLM 生成提示来引导黑盒 LLM 更好识别社交媒体用户社区,实验证明该方法在社区检测等任务上取得显著改进。

摘要:

社交媒体的大规模使用及其重大影响使得理解它变得日益重要。特别是识别用户社区,对许多下游任务很有帮助。然而,尤其是当模型在过去数据上训练并在未来数据上测试时,这样做很困难。在本文中,我们假设利用大型语言模型(LLM)来更好地识别用户社区。由于许多 LLM(如 ChatGPT)是固定的,必须被视为黑盒,我们提出通过训练较小的 LLM 来更好地提示它们的方法。我们设计了训练这个较小模型的策略,展示了它如何提升较大 LLM 检测社区的能力。实验结果显示在 Reddit 和 Twitter 数据上,在社区检测、机器人检测和新闻媒体分析任务中均有改进。

英文摘要:

The large scale usage of social media, combined with its significant impact, has made it increasingly important to understand it. In particular, identifying user communities, can be helpful for many downstream tasks. However, particularly when models are trained on past data and tested on future, doing this is difficult. In this paper, we hypothesize to take advantage of Large Language Models (LLMs), to better identify user communities. Due to the fact that many LLMs, such as ChatGPT, are fixed and must be treated as black-boxes, we propose an approach to better prompt them, by training a smaller LLM to do this. We devise strategies to train this smaller model, showing how it can improve the larger LLMs ability to detect communities. Experimental results show improvements on Reddit and Twitter data, on the tasks of community detection, bot detection, and news media profiling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑