arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.00615cs.IR
收藏

信息检索评价测度的内在框架

An Intrinsic Framework of Information Retrieval Evaluation Measures

Fernando Giner

AI总结:

本文基于表征测量理论提出检索测度的内在框架,仅利用测度取得值即可判定其度量与尺度属性,并据此对常见IR评价测度进行三类划分。

摘要:

信息检索(IR)评价测度是判断检索系统适用性和任务性能效率的基石。它们的度量与尺度属性使人们能够比较不同系统,从而确定差异或相似性。本文基于表征测量理论,通过利用检索测度本身所包含的信息来确定这些属性。论文建立了检索测度的内在框架;当领域集合未被明确指定时,这正是常见情形。文中给出了一种确定任意检索测度的度量与尺度属性的方法,该方法只需要知道其取得值中的一部分。该方法依据内在属性将检索测度划分为三大主要类别。一些常见的面向用户和面向系统的评价测度也依据所提出的分类体系进行了归类。

英文摘要:

Information retrieval (IR) evaluation measures are cornerstones for determining the suitability and task performance efficiency of retrieval systems. Their metric and scale properties enable to compare one system against another to establish differences or similarities. Based on the representational theory of measurement, this paper determines these properties by exploiting the information contained in a retrieval measure itself. It establishes the intrinsic framework of a retrieval measure, which is the common scenario when the domain set is not explicitly specified. A method to determine the metric and scale properties of any retrieval measure is provided, requiring knowledge of only some of its attained values. The method establishes three main categories of retrieval measures according to their intrinsic properties. Some common user-oriented and system-oriented evaluation measures are classified according to the presented taxonomy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑