PoPreRo:一个用于罗马尼亚语 Reddit 帖子流行度预测的新数据集
PoPreRo: A New Dataset for Popularity Prediction of Romanian Reddit Posts
AI总结:
本文提出首个罗马尼亚语 Reddit 帖子流行度预测数据集 PoPreRo(含 28,107 个样本),并提供多个基线模型;实验显示最佳模型仅达 61.35% 准确率,表明该任务极具挑战性。
摘要:
我们引入了 PoPreRo,这是第一个从 Reddit 收集的罗马尼亚语帖子流行度预测数据集。PoPreRo 数据集包含来自罗马尼亚五个不同子版块的多样化帖子样本汇编,共计 28,107 个数据样本。除了我们的新数据集,我们还引入了一组具有竞争力的模型,作为未来研究的基线。值得注意的是,得分最高的模型在测试集上达到了 61.35% 的准确率和 60.60% 的宏 F1 分数,这表明在 PoPreRo 上的流行度预测任务非常具有挑战性。基于对 Falcon-7B 大语言模型进行少样本提示的进一步研究也指向了相同的方向。因此,我们认为 PoPreRo 是一个有价值的资源,可用于评估模型在预测罗马尼亚语社交媒体帖子流行度方面的能力。我们在 https://github.com/ana-rogoz/PoPreRo 发布了我们的数据集。
英文摘要:
We introduce PoPreRo, the first dataset for Popularity Prediction of Romanian posts collected from Reddit. The PoPreRo dataset includes a varied compilation of post samples from five distinct subreddits of Romania, totaling 28,107 data samples. Along with our novel dataset, we introduce a set of competitive models to be used as baselines for future research. Interestingly, the top-scoring model achieves an accuracy of 61.35% and a macro F1 score of 60.60% on the test set, indicating that the popularity prediction task on PoPreRo is very challenging. Further investigations based on few-shot prompting the Falcon-7B Large Language Model also point in the same direction. We thus believe that PoPreRo is a valuable resource that can be used to evaluate models on predicting the popularity of social media posts in Romanian. We release our dataset at https://github.com/ana-rogoz/PoPreRo.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。