我们在HRI中报告什么以及如何报告?招聘、薪酬和性别报告的审查和建议
What and How Are We Reporting in HRI? A Review and Recommendations for Reporting Recruitment, Compensation, and Gender
摘要:
研究的可重复性和结果对广泛包容的人群的可推广性在任何研究中都是至关重要的。HRI以前的荟萃分析集中在不同类别的论文中报告信息的一致性。然而,HRI社区的成员注意到,许多可重复和可推广的研究所需的信息在已发表的论文中找不到。我们通过调查过去三年(2019年至2021年)报告的人机交互国际会议(HRI)以及alt.HRI主要会议记录的研究元数据来解决这个问题。根据分析结果,我们提出了一套建议,为HRI社区遵循长期的报告准则,从人机交互(HCI),心理学,和其他领域最相关的HRI。最后,我们研究了用户研究再现性的三个关键领域:招募细节,参与者补偿和参与者性别。我们发现这些研究元数据类别中的每一个都缺乏报告:在236项研究中,139项研究没有报告招募方法,118项研究没有报告补偿,62项研究没有报告性别数据。因此,这一分析为人力资源倡议需要改进的具体报告类型提供了指导。
英文摘要:
Study reproducibility and generalizability of results to broadly inclusive populations is crucial in any research. Previous meta-analyses in HRI have focused on the consistency of reported information from papers in various categories. However, members of the HRI community have noted that much of the information needed for reproducible and generalizable studies is not found in published papers. We address this issue by surveying the reported study metadata over the past three years (2019 through 2021) of the main proceedings of the International Conference on Human-Robot Interaction (HRI) as well as alt.HRI. Based on the analysis results, we propose a set of recommendations for the HRI community that follow the longer-standing reporting guidelines from human-computer interaction (HCI), psychology, and other fields most related to HRI. Finally, we examine three key areas for user study reproducibility: recruitment details, participant compensation, and participant gender. We find a lack of reporting within each of these study metadata categories: of the 236 studies, 139 studies failed to report recruitment method, 118 studies failed to report compensation, and 62 studies failed to report gender data. This analysis therefore provides guidance about specific types of needed reporting improvements for HRI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。