arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1809.06582cs.CVcs.MM
收藏

用于数字媒体的符号张量神经网络-从通过BNF图形规则的张量处理到CREAMS应用

Symbolic Tensor Neural Networks for Digital Media - from Tensor Processing via BNF Graph Rules to CREAMS Applications

Warsaw University of Technology(华沙理工大学)

Wladyslaw Skarbek

摘要:

卷积神经网络(CNN)及其在数字媒体研究中的应用的教程材料是基于符号张量神经网络的概念。STNN表达式的集合以巴科斯-诺尔形式(BNF)指定,该形式由标记无环有向图(DAG)的典型约束注释。BNF归纳从一组神经元符号开始,这些符号具有额外的(最多五个)装饰字段(包括张量深度和共享字段)。归纳规则不仅提供了一般的图结构,而且还提供了具体的快捷方式为剩余块的单位。通过自定义单元及其实例,提出了网络分片模块化的语法机制。此外,为了生成对偶符号张量神经网络(DSTNN),还指定了对偶BNF规则。STNN和DSTNN的联合解释提供了在训练阶段反向传播的梯度张量的正确流。提出的CNN的符号表示说明了六个通用的数字媒体应用程序(CREAMS):压缩,识别,嵌入,注释,3D建模的人机接口,和数据安全的数字媒体对象的基础上。为了使CNN描述和其梯度流完整,对于所有提出的应用,给出了所有使用的核心单元的数学定义的损失/增益函数和梯度流方程的符号表示。本教程是为了让读者相信,STNN不仅是一个方便的符号符号表示法,用于公开介绍基于CNN的CREAMS问题的解决方案,而且它是一个设计蓝图,具有自动生成应用程序源代码的潜力。

英文摘要:

This tutorial material on Convolutional Neural Networks (CNN) and its applications in digital media research is based on the concept of Symbolic Tensor Neural Networks. The set of STNN expressions is specified in Backus-Naur Form (BNF) which is annotated by constraints typical for labeled acyclic directed graphs (DAG). The BNF induction begins from a collection of neural unit symbols with extra (up to five) decoration fields (including tensor depth and sharing fields). The inductive rules provide not only the general graph structure but also the specific shortcuts for residual blocks of units. A syntactic mechanism for network fragments modularization is introduced via user defined units and their instances. Moreover, the dual BNF rules are specified in order to generate the Dual Symbolic Tensor Neural Network (DSTNN). The joined interpretation of STNN and DSTNN provides the correct flow of gradient tensors, back propagated at the training stage. The proposed symbolic representation of CNNs is illustrated for six generic digital media applications (CREAMS): Compression, Recognition, Embedding, Annotation, 3D Modeling for human-computer interfacing, and data Security based on digital media objects. In order to make the CNN description and its gradient flow complete, for all presented applications, the symbolic representations of mathematically defined loss/gain functions and gradient flow equations for all used core units, are given. The tutorial is to convince the reader that STNN is not only a convenient symbolic notation for public presentations of CNN based solutions for CREAMS problems but also that it is a design blueprint with a potential for automatic generation of application source code.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑