没有玫瑰是没有刺的:从模型、数据和以用户为中心的方法中发现BlenderBot 2.0的弱点
There is no rose without a thorn: Finding weaknesses on BlenderBot 2.0 in terms of Model, Data and User-Centric Approach
摘要:
BlenderBot 2.0是一个对话模型,通过使用互联网搜索模块和多会话反映实时信息并在较长时间内记住用户信息来表示开放域聊天机器人。尽管如此,该模式仍有改进的余地。为此,我们从三个角度研究BlenderBot 2.0的局限性和错误:模型,数据和用户。从数据的角度来看,我们强调在众包过程中向工人提供的指导方针不明确,以及缺乏在收集的数据中提炼仇恨言论和验证基于互联网的信息准确性的过程。从用户的角度来看,我们确定九种类型的BlenderBot 2.0的局限性,其原因进行了彻底的调查。此外,对于每个观点,我们提出了实际的改进方法,并讨论了几个潜在的未来研究方向。
英文摘要:
BlenderBot 2.0 is a dialogue model that represents open-domain chatbots by reflecting real-time information and remembering user information for an extended period using an internet search module and multi-session. Nonetheless, the model still has room for improvement. To this end, we examine BlenderBot 2.0 limitations and errors from three perspectives: model, data, and user. From the data point of view, we highlight the unclear guidelines provided to workers during the crowdsourcing process, as well as a lack of a process for refining hate speech in the collected data and verifying the accuracy of internet-based information. From a user perspective, we identify nine types of limitations of BlenderBot 2.0, and their causes are thoroughly investigated. Furthermore, for each point of view, we propose practical improvement methods and discuss several potential future research directions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。