利用人工智能规模化研究漫画:PAGE框架及美国漫画与日本漫画的三项研究
Studying Comics at Scale with Artificial Intelligence: The PAGE Framework and Three Studies of American Comics and Japanese Manga
AI总结:
本研究提出PAGE框架,结合AI技术对3929本美国漫画及87卷日本漫画开展三项研究,实现漫画的规模化分析,还可助力漫画档案检索、保护等应用。
摘要:
漫画是20世纪重要的视觉记录载体,拥有数十万页内容,大众读者从中见证了时代领袖、战争与英雄。但大部分记录从未被作为整体研究,漫画学术研究通常以单部作品为单位开展。本文提出人工智能(包括生成式模型)可改变这一现状,推动漫画媒介本身的发展。我们提出PAGE框架,将人工智能打造为漫画研究工具:该框架可将每幅扫描图像解析为分镜、文本及书目记录;采用遵循书面编码手册的视觉-语言模型为每页标注,模拟人类编码员的操作;将部分标注结果与人类注释对齐;并控制出版商与类型变量,分析整个档案中的变化。我们在3929本1938-1956年的美国漫画书及87卷日本漫画上验证该框架,开展三项分别基于不同能力的研究:第一项结合文本搜索与视觉阅读,探究大众媒介对政治权力的刻画方式;第二项测量行业内页面的视觉形式,识别单个艺术家的创作风格;第三项追踪两种漫画传统中的叙事者,结果经人类注释验证。除研究用途外,该工具还可让档案按绘制内容检索、为盲人和低视力读者开放漫画资源、保护脆弱藏品及标注未署名艺术家。我们提出研究议程,让人工智能强化漫画的研究、保护与传播。
英文摘要:
Comics are one of the great visual records of the twentieth century: hundreds of thousands of pages in which a mass readership saw its leaders, its wars and its heroes. Most of this record has never been studied as a whole; comics scholarship proceeds one book at a time. We argue that artificial intelligence, including generative models, can change this to the benefit of the medium itself. We propose PAGE, a framework that makes artificial intelligence an instrument for comics research. It parses every scan into panels, text and a bibliographic record; annotates each page with a vision-language model that follows a written codebook, as a human coder would; grounds samples of these readings in human annotation; and explains change across an archive, with estimates controlled for publisher and genre. We demonstrate the framework on 3,929 American comic books (1938--1956) and 87 volumes of Japanese manga, in three studies, each resting on a different capability. The first pairs text search with visual reading to recover how a mass medium portrayed political power. The second measures the page's visual form across an industry and recovers the hand of individual artists. The third follows who speaks across two comics traditions, checked against human annotation. Beyond research, the same instruments can make archives searchable by what is drawn, open comics to blind and low-vision readers, and help preserve fragile collections and credit uncredited artists. We outline a research agenda in which artificial intelligence strengthens the study, preservation and reach of the medium.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。