arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 1812.09617cs.CLcs.LG

Exploiting Cross-Lingual Subword Similarities in Low-Resource Document Classification

University of Maryland(马里兰大学);University of Colorado(科罗拉多大学);Google Research(谷歌研究院)

Mozhi Zhang, Yoshinari Fujinuma, Jordan Boyd-Graber

英文摘要:

Text classification must sometimes be applied in a low-resource language with no labeled training data. However, training data may be available in a related language. We investigate whether character-level knowledge transfer from a related language helps text classification. We present a cross-lingual document classification framework (CACO) that exploits cross-lingual subword similarity by jointly training a character-based embedder and a word-based classifier. The embedder derives vector representations for input words from their written forms, and the classifier makes predictions based on the word vectors. We use a joint character representation for both the source language and the target language, which allows the embedder to generalize knowledge about source language words to target language words with similar forms. We propose a multi-task objective that can further improve the model if additional cross-lingual or monolingual resources are available. Experiments confirm that character-level knowledge transfer is more data-efficient than word-level transfer between related languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑