首页/论文/2011.05988

arXiv 2011.059882020-11math.STcs.ITcs.LGmath.ITstat.COstat.MEstat.TH

Maximum sampled conditional likelihood for informative subsampling

University of Connecticut（康涅狄格大学）；Iowa State University（爱荷华州立大学）

HaiYing Wang, Jae Kwang Kim

英文摘要：

Subsampling is a computationally effective approach to extract information from massive data sets when computing resources are limited. After a subsample is taken from the full data, most available methods use an inverse probability weighted (IPW) objective function to estimate the model parameters. The IPW estimator does not fully utilize the information in the selected subsample. In this paper, we propose to use the maximum sampled conditional likelihood estimator (MSCLE) based on the sampled data. We established the asymptotic normality of the MSCLE and prove that its asymptotic variance covariance matrix is the smallest among a class of asymptotically unbiased estimators, including the IPW estimator. We further discuss the asymptotic results with the L-optimal subsampling probabilities and illustrate the estimation procedure with generalized linear models. Numerical experiments are provided to evaluate the practical performance of the proposed method.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

最大方差减少分层法以提升抽样

Maximum-Variance-Reduction Stratification for Improved Subsampling

MVRS通过最大方差减少分层法提升抽样效率，实现估计精度和效率的双重提升。

2026-02-27stat.ME

大规模弹性网回归的最优子抽样

Optimal subsampling for large scale Elastic-net regression

本文针对大规模弹性网回归提出一种基于A-最优性准则的随机化子抽样算法，利用alpha绝对值函数光滑逼近技术建立一致性分析、集中界与渐近正态性，并在合成与真实数据上验证其有效性。

2023-05-29math.STstat.TH

双加权泊松子采样用于大规模数据的卷积秩回归

Biweighted Poisson Subsampling for Convoluted Rank Regression with Massive Data

National University of Singapore（新加坡国立大学）；Chongqing University（重庆大学）；Xiamen University（厦门大学）

针对大规模数据中成对损失问题（如卷积秩回归），提出双加权泊松子采样（BIPS）框架，通过设计成对观测权重实现高效子采样，并证明估计量的相合性和渐近正态性，同时开发了分布式估计器。

2026-06-07math.STstat.TH

基于矩的子采样MLE改进方法

A Moment-assisted Approach for Improving Subsampling-based MLE with Large-scale data

Beijing University of Posts and Telecommunications（北京邮电大学）；Zhejiang Gongshang University（浙江工商大学）；Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）；Tsinghua University（清华大学）

本文提出基于矩的子采样方法，通过整合整体数据的矩信息提升子采样MLE的估计效率，理论分析显示其渐近方差更小，数值实验验证其在估计和计算效率上的优势。

2026-10-12stat.ME

杠杆分类器：对支持向量机的另一种审视

Leverage classifier: Another look at support vector machine

针对支持向量机计算量大难以应用于大规模数据集的问题，研究提出基于线性SVM的最优杠杆分类器，通过两阶段子采样选有信息的训练子集，推导相关统计性质，在估计、计算和预测上均优于现有方法。

2023-08-23stat.ME

Unweighted estimation based on optimal sample under measurement constraints

To tackle massive data, subsampling is a practical approach to select the more informative data points. However, when responses are expensive to measure, developing efficient subsampling schemes is challenging, and an optimal sampling approach under measurement constraints was developed to meet this challenge. This method uses the inverses of optimal sampling probabilities to reweight the objective function, which assigns smaller weights to the more important data points. Thus the estimation efficiency of the resulting estimator can be improved. In this paper, we propose an unweighted estimati…

2022-10-08stat.CO

更多相关论文收起更多论文

Optimal Subsampling Design for Polynomial Regression in one Covariate

Improvements in technology lead to increasing availability of large data sets which makes the need for data reduction and informative subsamples ever more important. In this paper we construct $ D $-optimal subsampling designs for polynomial regression in one covariate for invariant distributions of the covariate. We study quadratic regression more closely for specific distributions. In particular we make statements on the shape of the resulting optimal subsampling designs and the effect of the subsample size on the design. To illustrate the advantage of the optimal subsampling designs we exam…

2023-02-25math.STstat.TH

面向大规模线性分类的多分辨率子采样

Multi-resolution subsampling for large-scale linear classification

针对大数据下大规模线性分类的效率平衡问题，提出结合汇总统计全局信息与子采样点局部信息的多分辨率子采样策略，推导其渐近性质并通过仿真与真实数据验证了估计效率的提升。

2024-07-08math.STstat.MEstat.TH

广义线性模型可能被错误设定时的大数据集子抽样方法

A subsampling approach for large data sets when the Generalised Linear Model is potentially misspecified

针对现有子抽样方法依赖可能错误设定的统计模型这一缺陷，本文提出基于预测均方误差确定子抽样概率的新方法，并通过模拟和真实大数据集验证其有效性。

2025-10-07math.STstat.MEstat.TH

海量数据中单协变量 Poisson 回归

Poisson Regression in one Covariate on Massive Data

针对海量数据下全数据分析不可行的问题，在单协变量Poisson回归模型中构建局部$ D $-最优子抽样设计，并证明其相较均匀随机和启发式设计的效率优势。

2024-03-27math.STstat.TH

高维数据下个体化阈值测量受限M估计的主动子采样

Active Subsampling for Measurement-Constrained M-Estimation of Individualized Thresholds with High-Dimensional Data

Cornell University（康奈尔大学）

针对测量受限问题，提出K步主动子采样算法，通过迭代采样最具信息量的观测并求解正则化M估计，实现高维线性阈值参数估计，并揭示条件密度光滑性导致的相变现象。

2026-06-17math.STstat.MEstat.ML

Bayesian Estimation Under Informative Sampling

Bayesian analysis is increasingly popular for use in social science and other application areas where the data are observations from an informative sample. An informative sampling design leads to inclusion probabilities that are correlated with the response variable of interest. Model inference performed on the observed sample taken from the population will be biased for the population generative model under informative sampling since the balance of information in the sample data is different from that for the population. Typical approaches to account for an informative sampling design under B…

2016-06-03math.STstat.MEstat.TH