arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.12293cs.CLcs.AIcs.LG
收藏

通用语义学的一个数学模型

A mathematical model for universal semantics

Princeton University(普林斯顿大学);Beijing Institute of Big Data Research(北京大数据研究院)

Weinan E, Yajun Zhou

摘要:

我们通过对文本中重复出现的模式进行数学分析,用独立于语言的数字指纹来表征单词的含义。在长时间尺度上通过马尔可夫过程近似文本,我们能够从中等长度的特定文档中提取主题,发现同义词,并勾画语义场,而无需咨询外部知识库或词库。我们的马尔可夫语义模型使我们能够代表每个主题的概念由一个低维向量,解释为代数不变量的简洁的统计操作的文件,针对本地环境的个别单词。这些独立于语言的语义表示使机器人阅读器能够理解给定语言的短文本(自动问答),并在不同语言之间匹配中等长度的文本(自动单词翻译)。我们的语义指纹量化了5个主要语系14种代表性语言中单词的本地含义,提出了一种通用且具有成本效益的机制,可以在语义层面处理人类语言。我们的协议和源代码可在https://github.com/yajun-zhou/linguae-naturalis-principia-mathematica上公开获取

英文摘要:

We characterize the meaning of words with language-independent numerical fingerprints, through a mathematical analysis of recurring patterns in texts. Approximating texts by Markov processes on a long-range time scale, we are able to extract topics, discover synonyms, and sketch semantic fields from a particular document of moderate length, without consulting external knowledge-base or thesaurus. Our Markov semantic model allows us to represent each topical concept by a low-dimensional vector, interpretable as algebraic invariants in succinct statistical operations on the document, targeting local environments of individual words. These language-independent semantic representations enable a robot reader to both understand short texts in a given language (automated question-answering) and match medium-length texts across different languages (automated word translation). Our semantic fingerprints quantify local meaning of words in 14 representative languages across 5 major language families, suggesting a universal and cost-effective mechanism by which human languages are processed at the semantic level. Our protocols and source codes are publicly available on https://github.com/yajun-zhou/linguae-naturalis-principia-mathematica

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑