arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.04330stat.MEstat.ML
收藏

神经网络在不完整数据中的参数估计

Neural Parameter Estimation with Incomplete Data

King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学);University of New South Wales(新南威尔士大学);University of Wollongong(伍伦贡大学)

Matthew Sainsbury-Dale, Andrew Zammit-Mangion, Noel Cressie, Raphaël Huser

AI总结:

本文提出基于蒙特卡洛EM算法的神经网络参数估计方法,以解决不完整数据下的统计推断问题,相较于传统掩码方法更具效率和鲁棒性。

摘要:

人工智能和深度学习的进步使得神经网络被用于快速回答复杂科学问题、生成莫奈风格的绘画或像塔恩所写的故事。利用其计算速度和灵活性,神经网络也被用于促进快速、无似然的统计推断。然而,使用不完整数据的神经网络并不总是可行,这限制了其在许多应用中的使用。最近提出的一种方法通过适当填充的数据向量和编码缺失模式的向量作为输入来神经网络。虽然计算效率高,但这种

英文摘要:

Advances in artificial intelligence (AI) and deep learning have led to neural networks being used to generate lightning-speed answers to complex science questions, paintings in the style of Monet, or stories like those of Twain. Leveraging their computational speed and flexibility, neural networks are also being used to facilitate fast, likelihood-free statistical inference. However, it is not straightforward to use neural networks with data that for various reasons are incomplete, which precludes their use in many applications. A recently proposed approach to remedy this issue uses an appropriately padded data vector and a vector that encodes the missingness pattern as input to a neural network. While computationally efficient, this "masking" approach is not robust to the missingness mechanism and can result in statistically inefficient inferences. Here, we propose an alternative approach that is based on the Monte Carlo expectation-maximization (EM) algorithm. Our EM approach is likelihood-free, substantially faster than the conventional EM algorithm as it does not require numerical optimization at each iteration, and more statistically efficient than the masking approach. This research addresses a prototypical problem that asks how improvements could be made in AI by introducing Bayesian statistical thinking. We compare the two approaches to missingness using simulated incomplete data from a variety of spatial models. The utility of the methodology is shown on Arctic sea-ice data, analyzed using a novel hidden Potts model with an intractable likelihood.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑