政治科学中的LLM:预示视觉分析的新时代
LLMs in Political Science: Heralding a New Era of Visual Analysis
AI总结:
本文探讨了利用Gemini等大型语言模型进行图像内容分析的可行性,通过对688张图像的回顾性分析,发现其在目标检测等任务上准确率高、易用且免费,有望极大推动政治科学及社会科学领域的图像研究。
摘要:
政治学家对利用图像中丰富信息的兴趣日益浓厚。然而,解释这些图像的挑战在于需要计算机视觉的专业知识和专用硬件的访问权限。因此,图像分析仅限于政治科学界内相对较小的群体。得益于大型语言模型(LLMs)的兴起,这一局面可能会发生改变。本文旨在提高人们对使用Gemini进行图像内容分析可行性的认识。我们对包含688张图像的语料库进行了回顾性分析。针对每张图像,我们从Gemini获取内容报告,随后由作者进行人工评估。我们发现,Gemini在执行目标检测方面具有极高的准确性,这可以说是政治学家图像分析中最常见且最基础的任务。同样重要的是,我们展示了它易于实施,因为整个命令仅包含一个自然语言提示;运行速度快,应能满足大多数研究人员的时间预算;并且免费使用,不需要任何专用硬件。此外,我们说明了政治学家如何利用Gemini执行其他图像理解任务,包括人脸识别、情感分析和字幕生成。我们的研究结果表明,Gemini及其他类似LLMs有望极大地推动并加速政治科学及更广泛社会科学领域的图像研究。
英文摘要:
Interest is increasing among political scientists in leveraging the extensive information available in images. However, the challenge of interpreting these images lies in the need for specialized knowledge in computer vision and access to specialized hardware. As a result, image analysis has been limited to a relatively small group within the political science community. This landscape could potentially change thanks to the rise of large language models (LLMs). This paper aims to raise awareness of the feasibility of using Gemini for image content analysis. A retrospective analysis was conducted on a corpus of 688 images. Content reports were elicited from Gemini for each image and then manually evaluated by the authors. We find that Gemini is highly accurate in performing object detection, which is arguably the most common and fundamental task in image analysis for political scientists. Equally important, we show that it is easy to implement as the entire command consists of a single prompt in natural language; it is fast to run and should meet the time budget of most researchers; and it is free to use and does not require any specialized hardware. In addition, we illustrate how political scientists can leverage Gemini for other image understanding tasks, including face identification, sentiment analysis, and caption generation. Our findings suggest that Gemini and other similar LLMs have the potential to drastically stimulate and accelerate image research in political science and social sciences more broadly.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。