arXiv 0801.14402008-01-09stat.MLmath.STstat.TH

Parameterizations and fitting of bi-directed graph models to categorical data

Monia Lupparelli, Giovanni M. Marchetti, Wicher P. Bergsma

英文摘要：

We discuss two parameterizations of models for marginal independencies for discrete distributions which are representable by bi-directed graph models, under the global Markov property. Such models are useful data analytic tools especially if used in combination with other graphical models. The first parameterization, in the saturated case, is also known as the multivariate logistic transformation, the second is a variant that allows, in some (but not all) cases, variation independent parameters. An algorithm for maximum likelihood fitting is proposed, based on an extension of the Aitchison and Silvey method.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

超越Softmax：对分类随机变量的自然参数化

Beyond Softmax: A Natural Parameterization for Categorical Random Variables

Università della Svizzera italiana, IDSIA（瑞士大学、IDSIA）

本文提出Catnat函数作为替代Softmax的方案，通过信息几何视角分析其局限性，并通过实验展示其在提升学习效率和测试性能方面的优势。

2026-05-12cs.LGstat.ML

Parameter and Structure Learning in Nested Markov Models

The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with latent variables imply independence constraints in the distribution resulting from a 'fixing' operation, in which a joint distribution is divided by a conditional. This operation generalizes marginalizing and conditioning. Some of these constraints correspond to identifiable 'dormant' independence constraints, with the well known 'Verma constraint' as one exampl…

2012-07-20math.STstat.MLstat.TH

The Immersion of Directed Multi-graphs in Embedding Fields. Generalisations

Jiratech

The purpose of this paper is to outline a generalised model for representing hybrids of relational-categorical, symbolic, perceptual-sensory and perceptual-latent data, so as to embody, in the same architectural data layer, representations for the input, output and latent tensors. This variety of representation is currently used by various machine-learning models in computer vision, NLP/NLU, reinforcement learning which allows for direct application of cross-domain queries and functions. This is achieved by endowing a directed Tensor-Typed Multi-Graph with at least some edge attributes which r…

2020-04-28cs.AIcs.CVcs.LG

AdaCat: Adaptive Categorical Discretization for Autoregressive Models

University of California Berkeley（加州大学伯克利分校）

Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and use categorical distributions over the bins to approximate the continuous data distribution. The advantage is that the categorical distribution can easily express multiple modes and are straightforward to optimize. However, such approximation cannot express sharp changes in density without using significantly more bins, making it parameter inefficient. We pr…

2022-08-03cs.AIcs.LGstat.ML

一种简单统一的面向分类与有序数据的高维条件独立性检验方法

A Simple Unified Approach to Testing High-Dimensional Conditional Independences for Categorical and Ordinal Data

Radboud University（拉德堡德大学）

本文提出一种简单统一的高维条件独立性检验方法，适用于分类和有序数据，在稠密图模型检验与结构学习中优于现有基线，并兼具易实现、对称性和合理计算成本等优点。

2022-12-22cs.LGstat.ML

因果抽象：范畴论视角下的统一

Causal Abstractions, Categorically Unified

Eindhoven University of Technology（埃因霍温理工大学）

本研究提出基于范畴论的因果抽象统一框架，将其定义为马尔可夫函子间的自然变换，统一推广了现有因果抽象理论，结合弦图工具描述干预下的一致抽象图，验证了ADMG高层抽象上do-演算的低层有效性，可适配机制可解释性方法并重构相关抽象概念。

2025-10-06cs.LGstat.ML

更多相关论文收起更多论文

CardiCat：一种用于高基数表格数据的变分自编码器

CardiCat: a Variational Autoencoder for High-Cardinality Tabular Data

The Hebrew University of Jerusalem（耶路撒冷希伯来大学）

针对高基数混合类型表格数据生成难题，提出变分自编码器CardiCat，采用正则化双编码器-解码器嵌入层替代独热编码，实现紧凑参数化，在更小参数空间下生成高质量合成数据。

2025-01-28cs.LGstat.ML

Mixed Cumulative Distribution Networks

University College London（伦敦大学学院）；Gatsby Computational Neuroscience Unit（盖茨比计算神经科学研究组）

Directed acyclic graphs (DAGs) are a popular framework to express multivariate probability distributions. Acyclic directed mixed graphs (ADMGs) are generalizations of DAGs that can succinctly capture much richer sets of conditional independencies, and are especially useful in modeling the effects of latent variables implicitly. Unfortunately there are currently no good parameterizations of general ADMGs. In this paper, we apply recent work on cumulative distribution networks and copulas to propose one one general construction for ADMG models. We consider a simple parameter estimation approach,…

2010-08-31cs.LGstat.ML

Penalized Estimation of Directed Acyclic Graphs From Discrete Data

Bayesian networks, with structure given by a directed acyclic graph (DAG), are a popular class of graphical models. However, learning Bayesian networks from discrete or categorical data is particularly challenging, due to the large parameter space and the difficulty in searching for a sparse structure. In this article, we develop a maximum penalized likelihood method to tackle this problem. Instead of the commonly used multinomial distribution, we model the conditional distribution of a node given its parents by multi-logit regression, in which an edge is parameterized by a set of coefficient …

2018-02-02stat.MEstat.ML

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

University of South Florida（南佛罗里达大学）

The commonly used latent space embedding techniques, such as Principal Component Analysis, Factor Analysis, and manifold learning techniques, are typically used for learning effective representations of homogeneous data. However, they do not readily extend to heterogeneous data that are a combination of numerical and categorical variables, e.g., arising from linked GPS and text data. In this paper, we are interested in learning probabilistic generative models from high-dimensional heterogeneous data in an unsupervised fashion. The learned generative model provides latent unified representation…

2021-09-16cs.LGstat.ML

统计-神经交互网络用于可解释的混合类型数据填补

Statistical-Neural Interaction Networks for Interpretable Mixed-Type Data Imputation

Graduate School of Human Sciences, Waseda University（早稻田大学人类科学研究生院）；Faculty of Human Sciences, Waseda University（早稻田大学人类科学学院）

SNI通过结合统计先验和神经注意力实现可解释的混合类型数据填补，提供依赖诊断和权衡参数，优于部分基线方法。

2026-01-18cs.LGstat.ML

学习具有层次狄利克雷收缩的离散贝叶斯网络

Learning discrete Bayesian networks with hierarchical Dirichlet shrinkage

Gladstone Institute of Data Science and Biotechnology（格拉德斯通数据科学与生物技术研究所）；Duke University（杜克大学）

本文提出一种层次模型用于节点-父条件概率，通过后验诱导收缩低维潜在参数，结合Gibbs采样和Metropolis调整 Langevin 算法进行高效采样，并通过模拟验证方法在稀疏计数、图结构发现和竞争DAG选择中的性能，应用于乳腺癌预后网络结构分析。

2026-08-25stat.MEstat.ML

Training-image based geostatistical inversion using a spatial generative adversarial neural network

Belgian Nuclear Research Centre（比利时核研究中心）；Normandie Univ（诺曼底大学）；UNIROUEN（鲁昂大学）；UNIHAVRE（勒阿弗尔大学）；INSA Rouen（鲁昂国立应用科学学院）；LITIS（鲁昂信息科学与技术实验室）；University of Lausanne（洛桑大学）

Probabilistic inversion within a multiple-point statistics framework is often computationally prohibitive for high-dimensional problems. To partly address this, we introduce and evaluate a new training-image based inversion approach for complex geologic media. Our approach relies on a deep neural network of the generative adversarial network (GAN) type. After training using a training image (TI), our proposed spatial GAN (SGAN) can quickly generate 2D and 3D unconditional realizations. A key characteristic of our SGAN is that it defines a (very) low-dimensional parameterization, thereby allowi…

2019-01-08cs.CVphysics.geo-phstat.ML