arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.08056cs.CLcs.AIcs.LG
收藏

“是什么让一个问题好奇?“A Study on Type Controlled Inquisitive Question Generation”

"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generation

Toyota Technological Institute at Chicago(芝加哥丰田技术研究所);Educational Testing Service(教育考试服务中心)

Lingyu Gao, Debanjan Ghosh, Kevin Gimpel

摘要:

我们提出了一个类型控制的框架,好奇的问题生成。我们用问题类型注释一个查询问题数据集,训练问题类型分类器,并为类型控制的问题生成微调模型。实验结果表明,我们可以生成各种问题,坚持特定类型,同时从源文本中提取。我们还研究了从生成的集合中选择单个问题的策略,考虑到信息与~好奇问题分类器和从专家注释的小集合训练的成对排序器。使用成对排序器的问题选择在自动和手动评估中产生强有力的结果。我们的人工评估评估了生成的问题的多个方面,发现排名者选择了具有最佳语法(4.59),语义(4.37)和好奇心(3.92)的问题,评分范围为1-5,甚至可以与人类书面问题的表现相媲美。

英文摘要:

We propose a type-controlled framework for inquisitive question generation. We annotate an inquisitive question dataset with question types, train question type classifiers, and finetune models for type-controlled question generation. Empirical results demonstrate that we can generate a variety of questions that adhere to specific types while drawing from the source texts. We also investigate strategies for selecting a single question from a generated set, considering both an informative vs.~inquisitive question classifier and a pairwise ranker trained from a small set of expert annotations. Question selection using the pairwise ranker yields strong results in automatic and manual evaluation. Our human evaluation assesses multiple aspects of the generated questions, finding that the ranker chooses questions with the best syntax (4.59), semantics (4.37), and inquisitiveness (3.92) on a scale of 1-5, even rivaling the performance of human-written questions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑