技术辅助复习中持续主动学习的自主性和可靠性
Autonomy and Reliability of Continuous Active Learning for Technology-Assisted Review
摘要:
我们增强了Cormack和Grossman(SIGIR 2014)所示的持续主动学习方法的自主性,以有效地进行技术辅助评审,其中使用相关反馈检索和评审集合中的文档,直到基本上所有相关文档都被评审。通过消除特定于主题和特定于目录的调优参数来增强自主性,使得用户所需的唯一输入在开始时是简短的查询、主题描述或单个相关文档;并且在整个审查过程中,对检索到的文档进行持续的相关性评估。我们表明,我们的增强始终产生优越的结果,科马克和格罗斯曼的版本的持续主动学习,和其他方法,不仅平均,但对绝大多数的主题从四个独立的任务集:法律数据集检查科马克和格罗斯曼,路透社RCV 1-v2主题类别,TREC 6特设任务,和建设的TREC 2002过滤测试集合。
英文摘要:
We enhance the autonomy of the continuous active learning method shown by Cormack and Grossman (SIGIR 2014) to be effective for technology-assisted review, in which documents from a collection are retrieved and reviewed, using relevance feedback, until substantially all of the relevant documents have been reviewed. Autonomy is enhanced through the elimination of topic-specific and dataset-specific tuning parameters, so that the sole input required by the user is, at the outset, a short query, topic description, or single relevant document; and, throughout the review, ongoing relevance assessments of the retrieved documents. We show that our enhancements consistently yield superior results to Cormack and Grossman's version of continuous active learning, and other methods, not only on average, but on the vast majority of topics from four separate sets of tasks: the legal datasets examined by Cormack and Grossman, the Reuters RCV1-v2 subject categories, the TREC 6 AdHoc task, and the construction of the TREC 2002 filtering test collection.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。