CoLiDE:伴随线性有向无环图估计
CoLiDE: Concomitant Linear DAG Estimation
AI总结:
提出CoLiDE方法,通过伴随尺度估计的凸评分函数和光滑非凸无环性惩罚,在异方差噪声下高效学习线性DAG,优于现有方法且更稳定。
摘要:
我们处理从遵循线性结构方程模型(SEM)的观测数据中学习有向无环图(DAG)结构的组合问题。利用可微非凸无环性刻画的最新进展,近期的研究倡导使用连续约束优化范式来高效探索DAG空间。大多数现有方法采用lasso型评分函数来指导搜索,这(i)当未知的SEM噪声方差在不同问题实例间变化时,需要昂贵的惩罚参数重新调整;且(ii)隐式依赖同方差性限制假设。在这项工作中,我们提出了一种新的凸评分函数,用于稀疏感知的线性DAG学习,该函数结合了尺度的伴随估计,从而有效地将稀疏参数与外生噪声水平解耦。通过平滑非凸无环性惩罚项的正则化,得到CoLiDE(伴随线性DAG估计),这是一个基于回归的准则,适用于高效梯度计算和异方差场景下噪声方差的闭式估计。我们的算法在不增加复杂性的情况下优于最先进的方法,尤其是在DAG规模较大且噪声水平分布异构时。我们还发现CoLiDE在多个领域特定指标中表现出增强的稳定性,体现为标准差的降低,这凸显了我们新型线性DAG估计器的鲁棒性。
英文摘要:
We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure from observational data adhering to a linear structural equation model (SEM). Leveraging advances in differentiable, nonconvex characterizations of acyclicity, recent efforts have advocated a continuous constrained optimization paradigm to efficiently explore the space of DAGs. Most existing methods employ lasso-type score functions to guide this search, which (i) require expensive penalty parameter retuning when the $\textit{unknown}$ SEM noise variances change across problem instances; and (ii) implicitly rely on limiting homoscedasticity assumptions. In this work, we propose a new convex score function for sparsity-aware learning of linear DAGs, which incorporates concomitant estimation of scale and thus effectively decouples the sparsity parameter from the exogenous noise levels. Regularization via a smooth, nonconvex acyclicity penalty term yields CoLiDE ($\textbf{Co}$ncomitant $\textbf{Li}$near $\textbf{D}$AG $\textbf{E}$stimation), a regression-based criterion amenable to efficient gradient computation and closed-form estimation of noise variances in heteroscedastic scenarios. Our algorithm outperforms state-of-the-art methods without incurring added complexity, especially when the DAGs are larger and the noise level profile is heterogeneous. We also find CoLiDE exhibits enhanced stability manifested via reduced standard deviations in several domain-specific metrics, underscoring the robustness of our novel linear DAG estimator.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。