arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.10552cs.AI
收藏

“复杂论证框架的人类评价实证研究”技术报告

Technical report of "Empirical Study on Human Evaluation of Complex Argumentation Frameworks"

TU Dresden(德累斯顿工业大学);Université Libre de Bruxelles(布鲁塞尔自由大学)

Marcos Cramer, Mathieu Guillaume

摘要:

在抽象论证中,已经提出了多个论证语义,其允许从给定的论证框架中选择共同可接受的论证集合,即仅基于论证之间的攻击关系。多种论证语义的存在提出了这样一个问题,即这些语义中哪一种最能预测人类如何评价论证。以往的实证认知研究,已经测试了人类如何评估集的参数取决于它们之间的攻击关系已被限制到一个小的一组非常简单的论证框架,使一些语义研究的文献中不能有意义地区分这些研究。在本文中,我们报告的实证认知研究,克服了这些局限性,考虑到12个论证框架的三到八个参数。这些论证框架大多比以往研究中考虑的论证框架更复杂。所有12个论证框架系统地实例化与自然语言参数的基础上,一定的虚构的场景,和参与者都显示了自然语言参数和图形描述的攻击之间的关系。我们的数据表明,接地和CF2语义是最好的预测人类的论点评价。一个详细的分析表明,一部分参与者选择了一个认知上更简单的策略,预测非常好的接地语义,而另一部分的参与者选择了一个认知上更苛刻的策略,主要是预测以及CF2语义。

英文摘要:

In abstract argumentation, multiple argumentation semantics have been proposed that allow to select sets of jointly acceptable arguments from a given argumentation framework, i.e. based only on the attack relation between arguments. The existence of multiple argumentation semantics raises the question which of these semantics predicts best how humans evaluate arguments. Previous empirical cognitive studies that have tested how humans evaluate sets of arguments depending on the attack relation between them have been limited to a small set of very simple argumentation frameworks, so that some semantics studied in the literature could not be meaningfully distinguished by these studies. In this paper we report on an empirical cognitive study that overcomes these limitations by taking into consideration twelve argumentation frameworks of three to eight arguments each. These argumentation frameworks were mostly more complex than the argumentation frameworks considered in previous studies. All twelve argumentation framework were systematically instantiated with natural language arguments based on a certain fictional scenario, and participants were shown both the natural language arguments and a graphical depiction of the attack relation between them. Our data shows that grounded and CF2 semantics were the best predictors of human argument evaluation. A detailed analysis revealed that part of the participants chose a cognitively simpler strategy that is predicted very well by grounded semantics, while another part of the participants chose a cognitively more demanding strategy that is mostly predicted well by CF2 semantics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑