首页/论文/1908.04030

arXiv 1908.040302019-08stat.MLcs.LG

Modeling continuous-time stochastic processes using $\mathcal{N}$-Curve mixtures

Fraunhofer Institute of Optronics, System Technologies, and Image Exploitation (IOSB)（弗劳恩霍夫光电子、系统技术与图像利用研究所（IOSB））

Ronny Hug, Wolfgang Hübner, Michael Arens

英文摘要：

Representations of sequential data are commonly based on the assumption that observed sequences are realizations of an unknown underlying stochastic process, where the learning problem includes determination of the model parameters. In this context the model must be able to capture the multi-modal nature of the data, without blurring between modes. This property is essential for applications like trajectory prediction or human motion modeling. Towards this end, a neural network model for continuous-time stochastic processes usable for sequence prediction is proposed. The model is based on Mixture Density Networks using Bézier curves with Gaussian random variables as control points (abbrev.: $\mathcal{N}$-Curves). Key advantages of the model include the ability of generating smooth multi-mode predictions in a single inference step which reduces the need for Monte Carlo simulation, as required in many multi-step prediction models, based on state-of-the-art neural networks. Essential properties of the proposed approach are illustrated by several toy examples and the task of multi-step sequence prediction. Further, the model performance is evaluated on two real world use-cases, i.e. human trajectory prediction and human motion modeling, outperforming different state-of-the-art models.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Robust EM algorithm for model-based curve clustering

Information Sciences and Systems Laboratory (LSIS), UMR CNRS 7296（信息科学与系统实验室（LSIS），法国国家科学研究中心 UMR 7296）；University of the South Toulon-Var (USTV)（南土伦瓦尔大学（USTV））

Model-based clustering approaches concern the paradigm of exploratory data analysis relying on the finite mixture model to automatically find a latent structure governing observed data. They are one of the most popular and successful approaches in cluster analysis. The mixture density estimation is generally performed by maximizing the observed-data log-likelihood by using the expectation-maximization (EM) algorithm. However, it is well-known that the EM algorithm initialization is crucial. In addition, the standard EM algorithm requires the number of clusters to be known a priori. Some soluti…

2013-12-25cs.LGstat.MEstat.ML

Modelling Receiver Operating Characteristic Curves Using Gaussian Mixtures

The receiver operating characteristic curve is widely applied in measuring the performance of diagnostic tests. Many direct and indirect approaches have been proposed for modelling the ROC curve, and because of its tractability, the Gaussian distribution has typically been used to model both populations. We propose using a Gaussian mixture model, leading to a more flexible approach that better accounts for atypical data. Monte Carlo simulation is used to circumvent the issue of absence of a closed-form. We show that our method performs favourably when compared to the crude binormal curve and t…

2014-06-05stat.APstat.COstat.ME

Functional Mixture Discriminant Analysis with hidden process regression for curve classification

Institut Universitaire de France（法兰西大学研究院）

We present a new mixture model-based discriminant analysis approach for functional data using a specific hidden process regression model. The approach allows for fitting flexible curve-models to each class of complex-shaped curves presenting regime changes. The model parameters are learned by maximizing the observed-data log-likelihood for each class by using a dedicated expectation-maximization (EM) algorithm. Comparisons on simulated data with alternative approaches show that the proposed approach provides better results.

2013-12-25cs.LGstat.MEstat.ML

Mixture model-based functional discriminant analysis for curve classification

Information Sciences and Systems Laboratory (LSIS), UMR CNRS 7296（信息科学与系统实验室（LSIS），法国国家科学研究中心联合研究单位7296）；University of the South Toulon-Var (USTV)（南土伦瓦尔大学（USTV））；Institut Universitaire de France（法国大学研究院）

Statistical approaches for Functional Data Analysis concern the paradigm for which the individuals are functions or curves rather than finite dimensional vectors. In this paper, we particularly focus on the modeling and the classification of functional data which are temporal curves presenting regime changes over time. More specifically, we propose a new mixture model-based discriminant analysis approach for functional data using a specific hidden process regression model. Our approach is particularly adapted to both handle the problem of complex-shaped classes of curves, where each class is c…

2013-12-25cs.LGstat.MEstat.ML

Learning from Mixtures of Private and Public Populations

The Ohio State University（俄亥俄州立大学）；Princeton University（普林斯顿大学）

We initiate the study of a new model of supervised learning under privacy constraints. Imagine a medical study where a dataset is sampled from a population of both healthy and unhealthy individuals. Suppose healthy individuals have no privacy concerns (in such case, we call their data "public") while the unhealthy individuals desire stringent privacy protection for their data. In this example, the population (data distribution) is a mixture of private (unhealthy) and public (healthy) sub-populations that could be very different. Inspired by the above example, we consider a model in which the p…

2020-08-01cs.LGstat.ML

Near-optimal-sample estimators for spherical Gaussian mixtures

University of California, San Diego（加州大学圣地亚哥分校）

Statistical and machine-learning algorithms are frequently applied to high-dimensional data. In many of these applications data is scarce, and often much more costly than computation time. We provide the first sample-efficient polynomial-time estimator for high-dimensional spherical Gaussian mixtures. For mixtures of any $k$ $d$-dimensional spherical Gaussians, we derive an intuitive spectral-estimator that uses $\mathcal{O}_k\bigl(\frac{d\log^2d}{ε^4}\bigr)$ samples and runs in time $\mathcal{O}_{k,ε}(d^3\log^5 d)$, both significantly lower than previously known. The constant factor $\mathcal…

2014-02-19cs.DScs.ITcs.LG

更多相关论文收起更多论文

Model-based functional mixture discriminant analysis with hidden process regression for curve classification

Université de Toulon（土伦大学）；Aix Marseille Université（艾克斯-马赛大学）；ENSAM（国立高等工程技术学院）；Institut Universitaire de France（法国大学研究院）；IFSTTAR（法国交通与安全科学技术研究所）

In this paper, we study the modeling and the classification of functional data presenting regime changes over time. We propose a new model-based functional mixture discriminant analysis approach based on a specific hidden process regression model that governs the regime changes over time. Our approach is particularly adapted to handle the problem of complex-shaped classes of curves, where each class is potentially composed of several sub-classes, and to deal with the regime changes within each homogeneous sub-class. The proposed model explicitly integrates the heterogeneity of each class of cu…

2013-12-25cs.LGmath.STstat.ME

对抗性线性混合MDP中的无视界强化学习

Horizon-free Reinforcement Learning in Adversarial Linear Mixture MDPs

Tsinghua University（清华大学）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）

本文提出首个无视界策略搜索算法，解决对抗性线性混合MDP中的强化学习问题，实现~O((d+log(|S|^2|A|))√K)遗憾界，并证明其近乎最优性。

2023-05-15cs.LGmath.OCstat.ML

Piecewise regression mixture for simultaneous functional data clustering and optimal segmentation

Aix Marseille Université（艾克斯-马赛大学）；Université de Toulon（土伦大学）

This paper introduces a novel mixture model-based approach for simultaneous clustering and optimal segmentation of functional data which are curves presenting regime changes. The proposed model consists in a finite mixture of piecewise polynomial regression models. Each piecewise polynomial regression model is associated with a cluster, and within each cluster, each piecewise polynomial component is associated with a regime (i.e., a segment). We derive two approaches for learning the model parameters. The former is an estimation approach and consists in maximizing the observed-data likelihood …

2014-04-30cs.LGmath.STstat.ME

Tensor Moments of Gaussian Mixture Models: Theory and Applications

University of Texas at Austin（德克萨斯大学奥斯汀分校）

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size $n^d$, so working with moments naively is assumed to be prohibitively expensive for $d>2$ and larger values of $n$. In this work, we develop theory and numerical methods for \emph{implicit computations} with moment tensors of GMMs, reducing the computational and storage costs to $\mathcal{O}(n^2)$ and $\mathcal{O}(n^3)$, respectively, for general covariance ma…

2022-03-21cs.LGcs.NAmath.NA