arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.13693cs.OHcs.AIcs.HC
收藏

挑战赛设计路线图

Challenge design roadmap

INRIA(法国国家信息与自动化研究所)

Hugo Jair Escalante Balderas, Isabelle Guyon, Addison Howard, Walter Reade, Sebastien Treguer

AI总结:

本章面向竞赛组织者,结合 Kaggle、ChaLearn、Tailor 指南与 NeurIPS 提案模板,系统阐述如何从目标设定、提案规划到同行评审设计高质量挑战赛。

摘要:

挑战赛可以被视为一种激励参与者解决严肃任务的游戏。因此,竞赛组织者必须制定有效的游戏规则。然而,这些规则除了让参与者享受游戏之外,还具有多重目标。这些目标可能包括解决现实世界问题、推动科学或技术领域发展、做出科学发现以及教育公众。在许多方面,创建一项挑战赛类似于发布一款产品。它需要同等程度的热情和严格测试,目标是以参与者的形式吸引“客户”。该过程始于一个扎实的计划,例如最终将提交给国际会议并接受同行评审的竞赛提案。尽管同行评审不能保证质量,但它确实会促使组织者考虑其挑战赛的影响、发现潜在疏漏,并总体上提高其质量。本章为制定强有力的挑战赛计划提供了指南。材料借鉴了 Kaggle、ChaLearn 和 Tailor 等组织的筹备指南,以及部分作者参与编写的 NeurIPS 提案模板。

英文摘要:

Challenges can be seen as a type of game that motivates participants to solve serious tasks. As a result, competition organizers must develop effective game rules. However, these rules have multiple objectives beyond making the game enjoyable for participants. These objectives may include solving real-world problems, advancing scientific or technical areas, making scientific discoveries, and educating the public. In many ways, creating a challenge is similar to launching a product. It requires the same level of excitement and rigorous testing, and the goal is to attract ''customers'' in the form of participants. The process begins with a solid plan, such as a competition proposal that will eventually be submitted to an international conference and subjected to peer review. Although peer review does not guarantee quality, it does force organizers to consider the impact of their challenge, identify potential oversights, and generally improve its quality. This chapter provides guidelines for creating a strong plan for a challenge. The material draws on the preparation guidelines from organizations such as Kaggle 1 , ChaLearn 2 and Tailor 3 , as well as the NeurIPS proposal template, which some of the authors contributed to.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑