arXivDaily arXiv每日学术速递 周一至周五更新
arXiv math/0607647math.NAcs.NAmath.AGmath.OC
收藏

张量秩与最佳低秩逼近问题的不适定性

Tensor rank and the ill-posedness of the best low-rank approximation problem

Vin de Silva, Lek-Heng Lim

AI总结:

本文证明三阶及以上张量可能不存在最佳秩-r逼近,并利用弱解方法克服低秩逼近问题的不适定性。

摘要:

一直以来,人们持续关注寻找一个描述三阶及以上张量最优低秩逼近的定理,以类比矩阵的Eckart-Young定理。在本文中,我们认为这种朴素方法注定失败,因为与矩阵不同,三阶及以上张量可能不存在最佳秩-r逼近。这种现象比人们预想的更为普遍:在广泛的维度、阶数和秩范围内,无论选择何种范数(甚至Bregman散度),都可以构造出这种失败的例子。此外,我们表明这些反例在许多情况下具有正体积:它们不能被视作孤立现象。在一个极端情况下,我们展示了一个张量空间,其中没有秩-3张量具有最优秩-2逼近。值得注意的例外是秩-1张量和二阶张量。从更积极的角度,我们提出了一种自然的方法来克服低秩逼近问题的不适定性,即在真解不存在时使用弱解。在我们的工作中,我们强调仔细研究具体的低维例子作为迈向更一般结果的第一步的重要性。为此,我们对2×2×2张量的等价类进行了详细分析,并开发了将结果向上推广到更高阶数和维度的方法。最后,我们将我们的工作与从代数几何角度对张量的现有研究联系起来。张量的秩理论上可以给出半代数描述;即,可以由一个多项式不等式系统确定。特别地,我们广泛使用了2×2×2超行列式。

英文摘要:

There has been continued interest in seeking a theorem describing optimal low-rank approximations to tensors of order 3 or higher, that parallels the Eckart-Young theorem for matrices. In this paper, we argue that the naive approach to this problem is doomed to failure because, unlike matrices, tensors of order 3 or higher can fail to have best rank-r approximations. The phenomenon is much more widespread than one might suspect: examples of this failure can be constructed over a wide range of dimensions, orders and ranks, regardless of the choice of norm (or even Bregman divergence). Moreover, we show that in many instances these counterexamples have positive volume: they cannot be regarded as isolated phenomena. In one extreme case, we exhibit a tensor space in which no rank-3 tensor has an optimal rank-2 approximation. The notable exceptions to this misbehavior are rank-1 tensors and order-2 tensors. In a more positive spirit, we propose a natural way of overcoming the ill-posedness of the low-rank approximation problem, by using weak solutions when true solutions do not exist. In our work we emphasize the importance of closely studying concrete low-dimensional examples as a first step towards more general results. To this end, we present a detailed analysis of equivalence classes of 2-by-2-by-2 tensors, and we develop methods for extending results upwards to higher orders and dimensions. Finally, we link our work to existing studies of tensors from an algebraic geometric point of view. The rank of a tensor can in theory be given a semialgebraic description; i.e., can be determined by a system of polynomial inequalities. In particular we make extensive use of the 2-by-2-by-2 hyperdeterminant.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑