通过分配最优唯一值实现直方图规定化
Histogram Specification by Assignment of Optimal Unique Values
AI总结:
针对无局部信息数据的直方图规定化与分位数变换,论文扩展组映射律并结合最优传输的有序分配,提出快速、精确且最小 p 范数最优的通用算法。
摘要:
本文提出了两种用于无局部信息数据的直方图规定化和分位数变换的新算法。这些核心技术可作为需要规定给定数据集样本分布的应用的构建模块。直方图规定化最广为人知的是其图像增强应用,而分位数变换通常用于数据预处理中的数据归一化。在信号处理中,相关方法往往需要时间或空间信息;在数据预处理中,方法借助计算统计学成果,通过插值或近似来工作,并在速度与质量之间存在权衡。要兼顾没有局部信息的情形(例如表格数据),同时提供快速且精确的解决方案,并非易事。为此,我们采用图像处理中称为组映射律的概念,并提出一种扩展。所提出的扩展使我们能够构造一个凸泛函,在其中寻找输出唯一值与参考直方图之间的最佳近似。随后,我们应用有序分配解这一最优传输中的结果,从最优唯一值重建输出。两组结果表明,与传统方法和最先进方法相比,所提算法具有有效性。所提算法快速、精确,并且具有最小 p 范数最优性。此外,我们将这些算法定义为通用数据处理方法。因此,本文的贡献可以方便地融入众多学科的应用中,尤其是在应用数据科学领域。
英文摘要:
In this paper, we propose two novel algorithms for histogram specification and quantile transformation of data without local information. These are core techniques that can serve as building blocks for applications that require specifying the sample distribution of a given set of data. Histogram specification is best known for its image enhancement applications, whereas quantile transformation is typically employed in data preprocessing for data normalization. In signal processing, methods often require temporal or spatial information; in data preprocessing, methods work by interpolation or by approximation, drawing from results in computational statistics, and have a trade-off between speed and quality. It is nontrivial to accommodate for cases that do not have local information (e.g., tabular data) while also providing a fast, exact solution. For that, we take up a concept in image processing called group mapping law and propose an extension. The proposed extension allows us to formulate a convex functional where we look for the best approximation between the output unique values and the reference histogram. Then, we apply the ordered assignment solution, a result in optimal transport, to reconstruct the output from the optimal unique values. Two sets of results show the effectiveness of the proposed algorithms when compared to traditional and state-of-the-art methods. The proposed algorithms are fast, exact, and least $p$-norm optimal. Further, we define the algorithms as generic data processing methods. Thus, contributions from this paper can be easily incorporated in applications spanning many disciplines, especially in applied data science.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。