arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.00635stat.ME
收藏

流数据在线贝叶斯分析的组合模型

Composable Models for Online Bayesian Analysis of Streaming Data

Jonathan Law, Darren Wilkinson

摘要:

数据的数量和速度正在迅速增加,物联网(IoT)是这些数据的重要来源之一。物联网是一组连接的设备(事物),它们使用车载传感器不断记录周围环境的数据。这些设备可以以非常高的速率记录数据并将数据流传输到云端,从而导致高存储和分析成本。为了降低这些成本,我们可以在数据流到达时对其进行分析,以了解底层过程,执行插值和平滑,并进行预测和预测。状态空间建模的传统工具假设数据位于固定的规则时间网格上。然而,许多传感器会改变其采样频率,有时是自适应的,或者中断并重新启动,与先前的采样网格不同步,或者只是在不规则的时间生成事件数据。因此,希望将系统建模为在连续时间内演化的部分和不规则观测的马尔可夫过程。过程和观测模型都可能是非线性的。因此,粒子滤波器代表了在线分析的最简单方法。为了对物联网中捕获的各种数据进行建模,开发了一个功能性的可组合连续时间马尔可夫过程模型Scala库。

英文摘要:

Data is rapidly increasing in volume and velocity and the Internet of Things (IoT) is one important source of this data. The IoT is a collection of connected devices (things) which are constantly recording data from their surroundings using on-board sensors. These devices can record and stream data to the cloud at a very high rate, leading to high storage and analysis costs. In order to ameliorate these costs, we can analyse the data as it arrives in a stream to learn about the underlying process, perform interpolation and smoothing and make forecasts and predictions. Conventional tools of state space modelling assume data on a fixed regular time grid. However, many sensors change their sampling frequency, sometimes adaptively, or get interrupted and re-started out of sync with the previous sampling grid, or just generate event data at irregular times. It is therefore desirable to model the system as a partially and irregularly observed Markov process which evolves in continuous time. Both the process and the observation model are potentially non-linear. Particle filters therefore represent the simplest approach to online analysis. A functional Scala library of composable continuous time Markov process models has been developed in order to model the wide variety of data captured in the IoT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑