自动评估文本处理服务可信度的进展
Advances in Automatically Rating the Trustworthiness of Text Processing Services
摘要:
众所周知,人工智能服务在受到数据、模型或用户变化的影响时,行为不稳定。这些行为,无论是由疏忽还是委托引发的,都会在人工智能与人类合作时导致信任问题。目前在黑盒环境中评估人工智能服务的方法是有限的,在黑盒环境中,消费者无法访问人工智能的源代码或训练数据。消费者必须依赖AI开发人员的文档,并相信系统已经按照声明构建。此外,如果人工智能消费者重用该服务来构建他们出售给客户的其他服务,则消费者将面临服务提供商(数据和模型提供商)的风险。在这种情况下,我们的方法受到食品行业营养标签促进健康的成功的启发,并寻求从独立利益相关者的角度评估和评估人工智能服务的信任度。评级成为传达人工智能系统行为的一种手段,以便消费者了解风险并做出明智的决定。在本文中,我们将首先描述在开发基于文本的机器翻译AI服务的评级方法方面的最新进展,这些服务在用户研究中被发现很有前途。然后,我们将概述一个有原则的,多模式的,基于能力的评级方法的挑战和愿景,以及它对健康和食品推荐等现实场景中的决策支持的影响。
英文摘要:
AI services are known to have unstable behavior when subjected to changes in data, models or users. Such behaviors, whether triggered by omission or commission, lead to trust issues when AI works with humans. The current approach of assessing AI services in a black box setting, where the consumer does not have access to the AI's source code or training data, is limited. The consumer has to rely on the AI developer's documentation and trust that the system has been built as stated. Further, if the AI consumer reuses the service to build other services which they sell to their customers, the consumer is at the risk of the service providers (both data and model providers). Our approach, in this context, is inspired by the success of nutritional labeling in food industry to promote health and seeks to assess and rate AI services for trust from the perspective of an independent stakeholder. The ratings become a means to communicate the behavior of AI systems so that the consumer is informed about the risks and can make an informed decision. In this paper, we will first describe recent progress in developing rating methods for text-based machine translator AI services that have been found promising with user studies. Then, we will outline challenges and vision for a principled, multi-modal, causality-based rating methodologies and its implication for decision-support in real-world scenarios like health and food recommendation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。