This paper proposes a new nonlinear approach for additive functional regression with functional response based on kernel methods along with some slight reformulation and implementation of the linear regression and the spectral additive model. The latter methods have in common that the covariates and the response are represented in a basis and so, can only be applied when the response and the covariates belong to a Hilbert space, while the proposed method only uses the distances among data and thus can be applied to those situations where any of the covariates or the response is not Hilbert, typically normed or even metric spaces with a real vector structure. A comparison of these methods with other procedures readily available in R is preformed in a simulation study and in real datasets showing the results of the advantages of the nonlinear proposals and the small loss of efficiency when the simulation scenario is truly linear. The comparison is done in the Hilbert case as it is the only scenario where all the procedures can be compared. Finally, the supplementary material provides a visualization tool for checking the linearity of the relationship between a single covariate and the response, another real data example, and a link to a GitHub repository where the code and data are available.} %and an example considering that the response is not Hilbertian.
Comparative Analysis of Data Preprocessing Methods, Feature Selection Techniques and Machine Learning Models for Improved Classification and Regression Performance on Imbalanced Genetic Data
Evergreen Valley College(埃弗格林谷学院);Gilead Sciences(吉利德科学公司)
Bayesian bandwidth estimation for a nonparametric functional regression model with mixed types of regressors and unknown error density
在误差密度未知的框架下,研究了具有函数值、连续实值和离散值回归变量的非参数函数回归模型的带宽估计问题.从Shang(2013,Computational Statistics & Data Analysis)的最近工作扩展,我们通过残差的核密度估计来近似未知误差密度,其中回归函数由允许混合类型回归变量的函数Nadaraya-Watson估计器估计。在核形式误差密度下,推导了带宽参数的核似然和后验密度,提出了一种同时估计带宽的贝叶斯带宽估计方法。仿真研究表明,所提出的贝叶斯方法的回归函数和误差密度的估计精度。以食品质量控制中的光谱数据集为例,我们应用贝叶斯方法来选择具有混合类型回归变量的非参数函数回归模型中的最佳带宽。
In this paper, a functional partial quantile regression approach, a quantile regression analog of the functional partial least squares regression, is proposed to estimate the function-on-function linear quantile regression model. A partial quantile covariance function is first used to extract the functional partial quantile regression basis functions. The extracted basis functions are then used to obtain the functional partial quantile regression components and estimate the final model. In our proposal, the functional forms of the discretely observed random variables are first constructed via …
Functional data analysis (FDA) involves the analysis of data whose ideal units of observation are functions defined on some continuous domain, and the observed data consist of a sample of functions taken from some population, sampled on a discrete grid. Ramsay and Silverman's 1997 textbook sparked the development of this field, which has accelerated in the past 10 years to become one of the fastest growing areas of statistics, fueled by the growing number of applications yielding this type of data. One unique characteristic of FDA is the need to combine information both across and within funct…
A partial least squares approach for function-on-function interaction regression
A partial least squares regression is proposed for estimating the function-on-function regression model where a functional response and multiple functional predictors consist of random curves with quadratic and interaction effects. The direct estimation of a function-on-function regression model is usually an ill-posed problem. To overcome this difficulty, in practice, the functional data that belong to the infinite-dimensional space are generally projected into a finite-dimensional space of basis functions. The function-on-function regression model is converted to a multivariate regression mo…
Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density
This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model . Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the regression function , consisting of parametric and nonparametric components, can be estimated by functional principal component and functional Nadayara-Watson estimators. The estimation accuracy of the regression function and error density crucially depends on the optimal estimations of bandwidth and semi-metric. A Bayesian method is utilized to simultaneously e…
Shape-constrained Estimation in Functional Regression with Bernstein Polynomials
Shape restrictions on functional regression coefficients such as non-negativity, monotonicity, convexity or concavity are often available in the form of a prior knowledge or required to maintain a structural consistency in functional regression models. A new estimation method is developed in shape-constrained functional regression models using Bernstein polynomials. Specifically, estimation approaches from nonparametric regression are extended to functional data, properly accounting for shape-constraints in a large class of functional regression models such as scalar-on-function regression (SO…