In this work, we have proposed augmented KRnets including both discrete and continuous models. One difficulty in flow-based generative modeling is to maintain the invertibility of the transport map, which is often a trade-off between effectiveness and robustness. The exact invertibility has been achieved in the real NVP using a specific pattern to exchange information between two separated groups of dimensions. KRnet has been developed to enhance the information exchange among data dimensions by incorporating the Knothe-Rosenblatt rearrangement into the structure of the transport map. Due to the maintenance of exact invertibility, a full nonlinear update of all data dimensions needs three iterations in KRnet. To alleviate this issue, we will add augmented dimensions that act as a channel for communications among the data dimensions. In the augmented KRnet, a fully nonlinear update is achieved in two iterations. We also show that the augmented KRnet can be reformulated as the discretization of a neural ODE, where the exact invertibility is kept such that the adjoint method can be formulated with respect to the discretized ODE to obtain the exact gradient. Numerical experiments have been implemented to demonstrate the effectiveness of our models.
Exponential Family Estimation via Adversarial Dynamics Embedding
University of Illinois at Urbana Champaign(伊利诺伊大学厄巴纳-香槟分校);University College London(伦敦大学学院);Georgia Institute of Technology(佐治亚理工学院);Ant Financial(蚂蚁金服);University of Alberta(阿尔伯塔大学);Google Research Brain Team(谷歌研究大脑团队);Mila(蒙特利尔学习算法研究所);University of Montreal(蒙特利尔大学)
Factor-Augmented Regularized Model for Hazard Regression
高维数据的一个普遍特征是协变量之间的相关性,当协变量高度相关时,模型选择具有挑战性。为了对高维考克斯比例风险模型在协变量具有因子结构的情况下进行模型选择,提出了一种新的风险回归因子增广正则化模型(Factor-Augmented Regularized Model for Hazard Regression,FarmHazard),该模型建立在驱动协变量依赖的潜在因子之上,扩展了Cox模型.这个新的模型生成的程序,通过从高维协变量向量中学习因子和特质成分,然后将它们用作新的预测因子,分两步操作。Cox模型是一种广泛用于生存分析的半参数模型,其中删失数据和时间依赖性协变量带来了额外的技术挑战。在较弱的条件下证明了模型选择相合性和估计相合性。我们还开发了一个因子增广变量筛选程序来处理超高维问题中的强相关性。大量的模拟和真实数据实验表明,该方法具有良好的性能,在模型选择、样本外C指数和筛选等方面都优于其他方法.