arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.16601cs.CL
收藏

Tarab:阿拉伯歌词和诗歌的多方言语料库

Tarab: A Multi-Dialect Corpus of Arabic Lyrics and Poetry

College of Engineering(工程学院);Computer Science, VinUniversity(计算机科学,文大学)

Mo El-Haj

AI总结:

本文介绍了一个大规模的阿拉伯语创意文本语料库,包含256万行和1350万词,涵盖古典和现代阿拉伯语及六种主要方言,提供结构化元数据以支持跨时代的语言和风格分析。

摘要:

我们介绍了Tarab语料库,这是一个大规模的文化和语言资源,将阿拉伯歌曲歌词和诗歌整合到统一的分析框架中。该语料库包含256万行和超过1350万词,是目前最大的公开阿拉伯语创意文本语料库,涵盖古典和现代创作。Tarab在歌曲和诗歌之间平衡,并涵盖古典阿拉伯语、现代标准阿拉伯语(MSA)以及六种主要方言:埃及语、波斯湾语、黎凡特语、伊拉克语、苏丹语和马格里布语。语料库中的艺术家和诗人与28个现代国家和多个历史时期相关,涵盖从预伊斯兰时期到21世纪的十四世纪阿拉伯创作。每行都配有结构化元数据,描述语言变体、地理起源和历史或文化背景,从而支持跨流派和时间的语言、风格和历时分析。我们描述了数据收集、标准化和验证流程,并展示了变体识别和流派区分的基准分析。该数据集在HuggingFace上公开可用,网址为https://huggingface.co/datasets/drelhaj/Tarab。

英文摘要:

We introduce the Tarab Corpus, a large-scale cultural and linguistic resource that brings together Arabic song lyrics and poetry within a unified analytical framework. The corpus comprises 2.56 million verses and more than 13.5 million tokens, making it, to our knowledge, the largest open Arabic corpus of creative text spanning both classical and contemporary production. Tarab is broadly balanced between songs and poems and covers Classical Arabic, Modern Standard Arabic (MSA), and six major regional varieties: Egyptian, Gulf, Levantine, Iraqi, Sudanese, and Maghrebi Arabic. The artists and poets represented in the corpus are associated with 28 modern nation states and multiple historical eras, covering over fourteen centuries of Arabic creative expression from the Pre-Islamic period to the twenty-first century. Each verse is accompanied by structured metadata describing linguistic variety, geographic origin, and historical or cultural context, enabling comparative linguistic, stylistic, and diachronic analysis across genres and time. We describe the data collection, normalisation, and validation pipeline and present baseline analyses for variety identification and genre differentiation. The dataset is publicly available on HuggingFace at https://huggingface.co/datasets/drelhaj/Tarab.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑