Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured prediction, this internal structure is used to predict multiple outputs simultaneously, leading to more accurate and coherent predictions. Structural support vector machines (SSVMs) are nonprobabilistic models that optimize a joint input-output function through margin-based learning. Because SSVMs generally disregard the interplay between unary and interaction factors during the training phase, final parameters are suboptimal. Moreover, its factors are often restricted to linear combinations of input features, limiting its generalization power. To improve prediction accuracy, this paper proposes: (i) Joint inference and learning by integration of back-propagation and loss-augmented inference in SSVM subgradient descent; (ii) Extending SSVM factors to neural networks that form highly nonlinear functions of input features. Image segmentation benchmark results demonstrate improvements over conventional SSVM training methods in terms of accuracy, highlighting the feasibility of end-to-end SSVM training with neural factors.
Corrected Integrated Laplace Approximation for Bayesian Inference in Latent Gaussian Models
Manning College of Information and Computer Sciences University of Massachusetts Amherst(信息与计算机科学学院 马萨诸塞大学阿姆赫斯特分校);Department of Statistics University of British Columbia(统计学系 不列颠哥伦比亚大学)
Stability of Linear Structural Equation Models of Causal Inference
University of Maryland, College Park(马里兰大学帕克分校);Indian Institute of Science, Bangalore(印度科学理工学院班加罗尔分校);Microsoft Research, India(微软印度研究院)
研究了因果推理的线性结构方程模型($\LSEM$)中参数恢复问题的数值稳定性。从Wright(1920)开始的一长串工作集中于理解$\LSEM$的哪些子类允许有效的参数恢复。尽管经过了几十年的研究,这个问题仍未完全解决。本文的目标是补充这条线的工作,我们想了解的情况下,有效的恢复是可能的恢复问题的稳定性。Pearl因果关系概念的数值稳定性首先在Schulman和Srivastava(2016)中使用条件数的概念进行了研究,其中他们提供了病态的例子。在这项工作中,我们为$\LSEM$提供了条件数分析。首先证明了在一个充分条件下,对于$\LSEM$的某个子类\emph{bow-free}(Brito and Pearl(2002)),参数恢复是稳定的.我们进一步证明,\emph{randomly}选择的输入参数为这个家庭满足的条件,具有很大的概率。因此,对于这个家庭,在参数空间的一个大的子集,恢复是数值稳定的。接下来,我们构造一个例子$\LSEM$的四个顶点与\emph{unbounded}条件数。然后,我们通过模拟以及现实世界的实验社会学应用证实了我们的理论研究结果。最后,我们提供了一个通用的启发式估计任何$\LSEM$实例的条件数。