We introduce a new class of Poisson-exponential-Tweedie (PET) mixture in the framework of generalized linear models for ultra-overdispersed count data. The mean-variance relationship is of the form $m+m^{2}+ϕm^{p}$, where $ϕ$ and $p$ are the dispersion and Tweedie power parameters, respectively. The proposed model is equivalent to the exponential-Poisson-Tweedie models arising from geometric sums of Poisson-Tweedie random variables. In this respect, the PET models encompass the geometric versions of Hermite, Neyman Type A, Pólya-Aeppli, negative binomial and Poisson inverse Gaussian models. The algorithms we shall propose allow us to estimate the real power parameter, which works as an automatic distribution selection. Instead of the classical Poisson, zero-shifted geometric is presented as the reference count distribution. Practical properties are incorporated into the PET of new relative indexes of dispersion and zero-inflation phenomena. Simulation studies demonstrate that the proposed model highlights unbiased and consistent estimators for large samples. Illustrative practical applications are analyzed on count datasets; in particular, PET models for data without covariates and PET regression models. The PET models are compared to Poisson-Tweedie models showing that parameters of both models are adopted to data.
We present a new modelling approach for longitudinal count data that is motivated by the increasing availability of longitudinal RNA-sequencing experiments. The distribution of RNA-seq counts typically exhibits overdispersion, zero-inflation and heavy tails; moreover, in longitudinal designs repeated measurements from the same subject are typically (positively) correlated. We propose a generalized linear mixed model based on the Poisson-Tweedie distribution that can flexibly handle each of the aforementioned features of longitudinal overdispersed counts. We develop a computational approach to …
The Tweedie GLM is a widely used method for predicting insurance premiums. However, the structure of the logarithmic mean is restricted to a linear form in the Tweedie GLM, which can be too rigid for many applications. As a better alternative, we propose a gradient tree-boosting algorithm and apply it to Tweedie compound Poisson models for pure premiums. We use a profile likelihood approach to estimate the index and dispersion parameters. Our method is capable of fitting a flexible nonlinear Tweedie model and capturing complex interactions among predictors. A simulation study confirms the exce…
We propose a new class of discrete generalized linear models based on the class of Poisson-Tweedie factorial dispersion models with variance of the form $μ+ ϕμ^p$, where $μ$ is the mean, $ϕ$ and $p$ are the dispersion and Tweedie power parameters, respectively. The models are fitted by using an estimating function approach obtained by combining the quasi-score and Pearson estimating functions for estimation of the regression and dispersion parameters, respectively. This provides a flexible and efficient regression methodology for a comprehensive family of count models including Hermite, Neyman…
Real count data time series often show the phenomenon of the underdispersion and overdispersion. In this paper, we develop two extensions of the first-order integer-valued autoregressive process with Poisson innovations, based on binomial thinning, for modeling integer-valued time series with equidispersion, underdispersion and overdispersion. The main properties of the models are derived. The methods of conditional maximum likelihood, Yule-Walker and conditional least squares are used for estimating the parameters, and their asymptotic properties are established. We also use a test based on o…
Generalized Poisson Matrix Factorization for Overdispersed Count Data
Graduate School of Science and Engineering, Chuo University（中央大学理工学研究科）；School of Pharmaceutical Sciences, Wakayama Medical University（和歌山医科大学药学部）；Faculty of Science and Engineering, Chuo University（中央大学理工学部）
Kolmogorov-Type Maximal Inequalities for Independent and Dependent Negative Binomial Random Variables: Sharp Bounds, Sub-Exponential Refinements, and Applications to Overdispersed Count Data
National Technical University of Athens（雅典国立技术大学）；Archimedes/Athena Research Center（阿尔基米德/雅典研究中心）；Canisius University（卡尼休斯大学）
Marginalized models are in great demand by most researchers in the life sciences particularly in clinical trials, epidemiology, health-economics, surveys and many others since they allow generalization of inference to the entire population under study. For count data, standard procedures such as the Poisson regression and negative binomial model provide population average inference for model parameters. However, occurrence of excess zero counts and lack of independence in empirical data have necessitated their extension to accommodate these phenomena. These extensions, though useful, complicat…
Tweedie's compound Poisson model is a popular method to model insurance claims with probability mass at zero and nonnegative, highly right-skewed distribution. In particular, it is not uncommon to have extremely unbalanced data with excessively large proportion of zero claims, and even traditional Tweedie model may not be satisfactory for fitting the data. In this paper, we propose a boosting-assisted zero-inflated Tweedie model, called EMTboost, that allows zero probability mass to exceed a traditional model. We makes a nonparametric assumption on its Tweedie model component, that unlike a li…
Count data are ubiquitous in ecology and the Poisson generalized linear model (GLM) is commonly used to model the association between counts and explanatory variables of interest. When fitting this model to the data, one typically proceeds by first confirming that the data is not overdispersed and that there is no excess of zeros. If the data appear to be overdispersed or if there is any zero-inflation, key assumptions of the Poison GLM may be violated and researchers will then typically consider alternatives to the Poison GLM. An important question is whether the potential model selection bia…
We consider three new classes of exponential dispersion models of discrete probability distributions which are defined by specifying their variance functions in their mean value parameterization. In a previous paper (Bar-Lev and Ridder, 2020a), we have developed the framework of these classes and proved that they have some desirable properties. Each of these classes was shown to be overdispersed and zero inflated in ascending order, making them as competitive statistical models for those in use in statistical modeling. In this paper we elaborate on the computational aspects of their probabilit…
Rgbp is an R package that provides estimates and verifiable confidence intervals for random effects in two-level conjugate hierarchical models for overdispersed Gaussian, Poisson, and Binomial data. Rgbp models aggregate data from k independent groups summarized by observed sufficient statistics for each random effect, such as sample means, possibly with covariates. Rgbp uses approximate Bayesian machinery with unique improper priors for the hyper-parameters, which leads to good repeated sampling coverage properties for random effects. A special feature of Rgbp is an option that generates synt…
Conway-Maxwell-Poisson (CMP) distributions are flexible generalizations of the Poisson distribution for modelling overdispersed or underdispersed counts. The main hindrance to their wider use in practice seems to be the inability to directly model the mean of counts, making them not compatible with nor comparable to competing count regression models, such as the log-linear Poisson, negative-binomial or generalized Poisson regression models. This note illustrates how CMP distributions can be parametrized via the mean, so that simpler and more easily-interpretable mean-models can be used, such a…
The analysis of count data is commonly done using Poisson models. Negative binomial models are a straightforward and readily motivated generalization for the case of overdispersed data, i.e., when the observed variance is greater than expected under a Poissonian model. Rate and overdispersion parameters then need to be considered jointly, which in general is not trivial. Here we are concerned with evidence synthesis in the case where the reporting of data is rather heterogeneous, i.e., events are reported either in terms of mean event counts, the proportion of event-free patients, or rate esti…
Bayesian mortality forecasting with a Conway--Maxwell--Poisson specification
School of Mathematics, Statistics, and Actuarial Science, University of Essex（埃塞克斯大学数学、统计与精算学院）；Department of Mathematics, University of Connecticut（康涅狄格大学数学系）
Count data, for example the number of observed cases of a disease in a city, often arise in the fields of healthcare analytics and epidemiology. In this paper, we consider performing regression on multivariate data in which our outcome is a count. Specifically, we derive log-likelihood functions for finite mixtures of regression models involving counts that come from a Poisson distribution, as well as a negative binomial distribution when the counts are significantly overdispersed. Within our proposed modeling framework, we carry out optimal component selection using the information criteria s…
Univariate regression models have rich literature for counting data. However, this is not the case for multivariate count data. Therefore, we present the Multivariate Generalized Linear Mixed Models framework that deals with a multivariate set of responses, measuring the correlation between them through random effects that follows a multivariate normal distribution. This model is based on a GLMM with a random intercept and the estimation process remains the same as a standard GLMM with random effects integrated out via Laplace approximation. We efficiently implemented this model through the TM…
The premise of independence among subjects in the same cluster/group often fails in practice, and models that rely on such untenable assumption can produce misleading results. To overcome this severe deficiency, we introduce a new regression model to handle overdispersed and correlated clustered counts. To account for correlation within clusters, we propose a Poisson regression model where the observations within the same cluster are driven by the same latent random effect that follows the Birnbaum-Saunders distribution with a parameter that controls the strength of dependence among the indivi…
In the analysis of count data often the equidispersion assumption is not suitable, hence the Poisson regression model is inappropriate. As a generalization of the Poisson distribution, the COM-Poisson distribution can deal with under-, equi- and overdispersed count data. It is a member of the exponential family of distributions and has well known special cases. In spite of the nice properties of the COM-Poisson distribution, its location parameter does not correspond to the expectation, which complicates the interpretation of regression models. In this paper, we propose a straightforward repar…
In their fundamental paper on cubic variance functions, Letac and Mora (The Annals of Statistics,1990) presented a systematic, rigorous and comprehensive study of natural exponential families on the real line, their characterization through their variance functions and mean value parameterization. They presented a section that for some reason has been left unnoticed. This section deals with the construction of variance functions associated with natural exponential families of counting distributions on the set of nonnegative integers and allows to find the corresponding generating measures. As …
Inverse Probability Weighting of Count Exposures in the Presence of Missing Data: A Simulation Study
Centre for Longitudinal Studies, UCL Social Research Institute, University College London（长期研究发展中心，UCL社会研究所，伦敦大学学院）；Research Department of Behavioural Science and Health, Institute of Epidemiology and Health Care, University College London（行为科学与健康研究系，流行病学与健康护理研究所，伦敦大学学院）
