arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.00077stat.MEstat.ML
收藏

CLARITY --使用dissimiLARITY比较异构数据

CLARITY -- Comparing heterogeneous data using dissimiLARITY

Daniel J. Lawson, Vinesh Solanki, Igor Yanovich, Johannes Dellert, Damian Ruck, Phillip Endicott

摘要:

整合来自不同学科的数据集是很困难的,因为这些数据在意义、规模和可靠性上往往是不同的。当两个数据集描述相同的实体时,许多科学问题都可以围绕实体之间的(不)相似性是否在这些不同的数据中保持不变。我们的方法,quality,量化数据集之间的一致性,识别哪里出现不一致,并帮助他们的解释。我们使用三种不同的比较来说明这一点:基因甲基化与表达,语言声音与词汇使用的演变,以及国家层面的经济指标与文化信仰。非参数方法对噪声和缩放差异具有鲁棒性,并且仅对数据如何生成做出弱假设。它通过将相似性分解为两个组成部分来运作:一个类似于聚类的“结构”组成部分,以及这些结构之间的潜在“关系”。这使得可以利用“结构”的可预测性,在两个相似性矩阵之间进行“结构比较”。在适合每个数据集的重新采样的帮助下评估显著性。该软件名为“Rightity”,可从https://github.com/danjlawson/CLARITY获得R软件包。

英文摘要:

Integrating datasets from different disciplines is hard because the data are often qualitatively different in meaning, scale, and reliability. When two datasets describe the same entities, many scientific questions can be phrased around whether the (dis)similarities between entities are conserved across such different data. Our method, CLARITY, quantifies consistency across datasets, identifies where inconsistencies arise, and aids in their interpretation. We illustrate this using three diverse comparisons: gene methylation vs expression, evolution of language sounds vs word use, and country-level economic metrics vs cultural beliefs. The non-parametric approach is robust to noise and differences in scaling, and makes only weak assumptions about how the data were generated. It operates by decomposing similarities into two components: a `structural' component analogous to a clustering, and an underlying `relationship' between those structures. This allows a `structural comparison' between two similarity matrices using their predictability from `structure'. Significance is assessed with the help of re-sampling appropriate for each dataset. The software, CLARITY, is available as an R package from https://github.com/danjlawson/CLARITY.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑