渐进式口译综合:量化先前使用和未使用的信息解决口译任务
Progressive Interpretation Synthesis: Interpreting Task Solving by Quantifying Previously Used and Unused Information
摘要:
深度神经网络是一个很好的任务解决器,但很难理解它的操作。如何形成对其运作的解释,人们众说纷纭。我们从一个新的角度来看待这个问题,其中任务解决的解释是通过量化除了用于解决以前的任务的信息之外,还有多少以前未使用的信息被利用来合成的。首先,在学习多个任务后,网络获取与每个任务相关的多个信息分区。然后,我们建议网络学习最小信息分区,以补充先前学习的信息分区,从而更准确地表示输入。这个额外的分区与在先前的任务中未使用的未概念化的信息相关联。我们设法识别使用了哪些非概念化信息并量化其数量。为了解释网络如何解决新任务,我们将每个分区中提取的信息量量化为元信息。我们实现了这个框架的变分信息瓶颈技术。我们用MNIST和CLEVR数据集测试了这个框架。该框架被证明是能够组成的信息分区和合成的元信息的形式依赖于经验的解释。该系统通过将一部分未概念化的信息分区转换为任务相关的分区,逐步提高了对新经验的解释分辨率。它还可以通过对解决新任务所需的先前未概念化信息的一部分进行成像来提供视觉解释。
英文摘要:
A deep neural network is a good task solver, but it is difficult to make sense of its operation. People have different ideas about how to form the interpretation about its operation. We look at this problem from a new perspective where the interpretation of task solving is synthesized by quantifying how much and what previously unused information is exploited in addition to the information used to solve previous tasks. First, after learning several tasks, the network acquires several information partitions related to each task. We propose that the network, then, learns the minimal information partition that supplements previously learned information partitions to more accurately represent the input. This extra partition is associated with un-conceptualized information that has not been used in previous tasks. We manage to identify what un-conceptualized information is used and quantify the amount. To interpret how the network solves a new task, we quantify as meta-information how much information from each partition is extracted. We implement this framework with the variational information bottleneck technique. We test the framework with the MNIST and the CLEVR dataset. The framework is shown to be able to compose information partitions and synthesize experience-dependent interpretation in the form of meta-information. This system progressively improves the resolution of interpretation upon new experience by converting a part of the un-conceptualized information partition to a task-related partition. It can also provide a visual interpretation by imaging what is the part of previously un-conceptualized information that is needed to solve a new task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。