arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.06132cs.IRcs.AIcs.LG
收藏

用于信息检索的学习表示和代理

Learning Representations and Agents for Information Retrieval

New York University, Tandon School of Engineering(纽约大学坦登工程学院);Universidade Estadual de Campinas(坎皮纳斯州立大学);Siemens(西门子)

Rodrigo Nogueira

摘要:

人工智能和信息检索的一个共同目标是创造一个神谕,也就是一个可以回答我们问题的机器,无论这些问题有多难。这个预言的一个更有限但仍然是工具性的版本是问答系统,其中向机器提出一个开放式问题,并根据它所获得的知识产生答案。这样的系统已经存在,并且越来越能够回答复杂的问题。这一进展部分归功于机器学习最近的成功,以及存储和检索信息的有效方法,特别是通过网络搜索引擎。可以想象,这个通用的问答系统可以构建为一个十亿参数的神经网络,通过大量的问题和答案对进行端到端训练。然而,我们认为,尽管这种方法在机器翻译等任务中非常成功,但将世界知识存储为学习机器的参数可能非常困难。一种更有效的方法是训练人工代理如何使用外部检索系统来收集相关信息。这个代理可以通过学习如何最好地利用它们来完成任务,从而利用已经投入到设计和运行高效存储和检索系统中的努力。...

英文摘要:

A goal shared by artificial intelligence and information retrieval is to create an oracle, that is, a machine that can answer our questions, no matter how difficult they are. A more limited, but still instrumental, version of this oracle is a question-answering system, in which an open-ended question is given to the machine, and an answer is produced based on the knowledge it has access to. Such systems already exist and are increasingly capable of answering complicated questions. This progress can be partially attributed to the recent success of machine learning and to the efficient methods for storing and retrieving information, most notably through web search engines. One can imagine that this general-purpose question-answering system can be built as a billion-parameters neural network trained end-to-end with a large number of pairs of questions and answers. We argue, however, that although this approach has been very successful for tasks such as machine translation, storing the world's knowledge as parameters of a learning machine can be very hard. A more efficient way is to train an artificial agent on how to use an external retrieval system to collect relevant information. This agent can leverage the effort that has been put into designing and running efficient storage and retrieval systems by learning how to best utilize them to accomplish a task. ...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑