arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.04497cs.CLcs.AI
收藏

大型语言模型在人文学科研究中低资源语言的机会与挑战

Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research

School of Computing, The University of Georgia(佐治亚大学计算机学院);Department of Mathematical and Statistical Sciences, University of Alberta(阿尔伯塔大学数学与统计科学系);University of California, Los Angeles(加州大学洛杉矶分校);Department of Radiology, Massachusetts General Hospital and Harvard Medical School(麻省总医院放射科和哈佛医学院)

Tianyang Zhong, Zhenyuan Yang, Zhengliang Liu, Ruidong Zhang, Weihang You, Yiheng Liu, Haiyang Sun, Yi Pan, Yiwei Li, Yifan Zhou, Hanqi Jiang, Junhao Chen, Xiang Li, Tianming Liu

AI总结:

本文探讨了大型语言模型在低资源语言研究中的应用,分析了数据获取、模型适应性和文化敏感性等挑战,并强调了跨学科合作与定制模型的重要性。

摘要:

低资源语言作为人类历史的重要存储库,承载着文化演变和智力多样性。尽管其重要性,这些语言面临数据稀缺和技术限制等关键挑战,阻碍了全面研究和保护。近期大型语言模型(LLMs)的进步为解决这些挑战提供了变革性机会,使语言学、历史和文化研究得以创新。本文系统评估了LLMs在低资源语言研究中的应用,涵盖语言变异、历史记录、文化表达和文学分析。通过分析技术框架、当前方法和伦理考量,本文识别了数据可及性、模型适应性和文化敏感性等关键挑战。鉴于低资源语言固有的文化、历史和语言丰富性,本文强调跨学科合作和定制模型的发展作为推动该领域研究的可行途径。通过强调将人工智能与人文学科结合以保护和研究人类语言和文化遗产的潜力,本文促进了全球保护智力多样性的努力。

英文摘要:

Low-resource languages serve as invaluable repositories of human history, embodying cultural evolution and intellectual diversity. Despite their significance, these languages face critical challenges, including data scarcity and technological limitations, which hinder their comprehensive study and preservation. Recent advancements in large language models (LLMs) offer transformative opportunities for addressing these challenges, enabling innovative methodologies in linguistic, historical, and cultural research. This study systematically evaluates the applications of LLMs in low-resource language research, encompassing linguistic variation, historical documentation, cultural expressions, and literary analysis. By analyzing technical frameworks, current methodologies, and ethical considerations, this paper identifies key challenges such as data accessibility, model adaptability, and cultural sensitivity. Given the cultural, historical, and linguistic richness inherent in low-resource languages, this work emphasizes interdisciplinary collaboration and the development of customized models as promising avenues for advancing research in this domain. By underscoring the potential of integrating artificial intelligence with the humanities to preserve and study humanity's linguistic and cultural heritage, this study fosters global efforts towards safeguarding intellectual diversity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑