GET-Tok:一个记录2022年秘鲁未遂政变的生成式AI增强多模态TikTok数据集
GET-Tok: A GenAI-Enriched Multimodal TikTok Dataset Documenting the 2022 Attempted Coup in Peru
AI总结:
本文提出GET-Tok流程,利用生成式AI增强TikTok研究API,收集秘鲁未遂政变相关视频数据,以促进多模态社交媒体分析。
摘要:
TikTok是世界上最大且增长最快的社交媒体网站之一。然而,TikTok的功能,如语音转录,往往缺失,而其他重要功能,如OCR或视频描述,并不存在。我们引入了生成式AI增强的TikTok(GET-Tok)数据,这是一个通过将生成式AI模型增强TikTok研究API来收集TikTok视频和增强数据的流程。作为案例研究,我们收集了关于秘鲁前总统佩德罗·卡斯蒂略发起的未遂政变及其伴随抗议活动的视频。数据包括2022年11月20日至2023年3月1日(102天)期间发布的43,697个视频的信息。生成式AI通过TikTok视频的转录、视频中显示内容的文本描述、视频内显示的文本以及视频中表达的立场来增强收集的数据。总体而言,该流程将有助于更好地理解多模态环境中的在线讨论,并应用生成式AI,特别是在非英语社交媒体中展示该流程的实用性。我们用于生成该流程的代码位于公共Github仓库:https://github.com/gabbypinto/GET-Tok-Peru。
英文摘要:
TikTok is one of the largest and fastest-growing social media sites in the world. TikTok features, however, such as voice transcripts, are often missing and other important features, such as OCR or video descriptions, do not exist. We introduce the Generative AI Enriched TikTok (GET-Tok) data, a pipeline for collecting TikTok videos and enriched data by augmenting the TikTok Research API with generative AI models. As a case study, we collect videos about the attempted coup in Peru initiated by its former President, Pedro Castillo, and its accompanying protests. The data includes information on 43,697 videos published from November 20, 2022 to March 1, 2023 (102 days). Generative AI augments the collected data via transcripts of TikTok videos, text descriptions of what is shown in the videos, what text is displayed within the video, and the stances expressed in the video. Overall, this pipeline will contribute to a better understanding of online discussion in a multimodal setting with applications of Generative AI, especially outlining the utility of this pipeline in non-English-language social media. Our code used to produce the pipeline is in a public Github repository: https://github.com/gabbypinto/GET-Tok-Peru.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。