arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.02607math.OCcs.DM
收藏

一个用于稀疏整数最小二乘问题的SDP松弛

An SDP Relaxation for the Sparse Integer Least Squares Problem

University of Wisconsin-Madison(威斯康星大学麦迪逊分校)

Alberto Del Pia, Dekun Zhou

AI总结:

本文提出了一种基于ℓ1的SDP松弛方法和随机算法,用于解决NP难的稀疏整数最小二乘问题,能够在高稀疏度条件下以高概率获得近似解,并适用于二元二次规划问题。

摘要:

在本文中,我们研究了稀疏整数最小二乘问题(SILS),这是NP难的最小二乘问题变种,要求稀疏{0,±1}向量。我们提出了一种基于ℓ1的SDP松弛方法和一种随机算法,该算法在稀疏常数σ<<T的条件下,以渐近逼近比1/T²的概率计算可行解。我们的算法能够处理大规模问题,对于维度高达d=10,000的情况提供高质量的近似解。所提出的随机算法广泛应用于具有基数约束的二元二次规划问题,即使对于非凸目标函数也是如此。对于固定的稀疏度,我们提供了SDP松弛能够解决SILS的充分条件,即任何SDP松弛的最优解都能转化为SILS的最优解。能够保证SDP解决SILS的数据类别足够广泛,足以涵盖许多现实应用,如隐私保护识别和多用户检测。我们通过两个应用特定的案例验证这些条件:在特征提取问题中,我们的松弛方法在亚高斯数据和弱协方差条件下解决问题;在整数稀疏恢复问题中,我们的松弛方法在高和低相干性条件下在某些条件下解决问题。

英文摘要:

In this paper, we study the \emph{sparse integer least squares problem} (SILS), an NP-hard variant of least squares with sparse $\{0, \pm 1\}$-vectors. We propose an $\ell_1$-based SDP relaxation, and a randomized algorithm for SILS, which computes feasible solutions with high probability with an asymptotic approximation ratio $1/T^2$ as long as the sparsity constant $σ\ll T$. Our algorithm handles large-scale problems, delivering high-quality approximate solutions for dimensions up to $d = 10,000$. The proposed randomized algorithm applies broadly to binary quadratic programs with a cardinality constraint, even for non-convex objectives. For fixed sparsity, we provide sufficient conditions for our SDP relaxation to solve SILS, meaning that any optimal solution to the SDP relaxation yields an optimal solution to SILS. The class of data input which guarantees that SDP solves SILS is broad enough to cover many cases in real-world applications, such as privacy preserving identification and multiuser detection. We validate these conditions in two application-specific cases: the \emph{feature extraction problem}, where our relaxation solves the problem for sub-Gaussian data with weak covariance conditions, and the \emph{integer sparse recovery problem}, where our relaxation solves the problem in both high and low coherence settings under certain conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑