arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.11014cs.LGcs.AI
收藏

人工神经网络中的潜在通信

Latent Communication in Artificial Neural Networks

Luca Moschella

AI总结:

本文研究神经网络潜在表征的跨模型通用性,提出潜在通信概念,通过数据分布间的部分语义对应实现相对表征投影或空间转换,并在多任务、多监督方式和多模态下验证其普遍性。

摘要:

随着神经网络(NN)渗透到各种科学和工业领域,理解其表征的普遍性和可重用性变得至关重要。这些网络的核心是创建输入数据的中间神经表征(表示为潜在空间),随后利用它们执行特定的下游任务。本论文聚焦于神经表征的普遍性和可重用性。由神经网络精心构建的潜在表征是特定训练实例所独有的,还是可以跨模型泛化,以适应训练过程中的随机性、模型架构甚至数据领域等因素?这种适应性品质引入了潜在通信(Latent Communication)的概念——这一现象描述了表征何时可以在神经空间之间统一或重用。我们研究中的一个显著观察结果是,即使潜在表征源自不同或看似不相关的神经网络,它们也会出现相似性。通过利用建立语义联系的两个数据分布之间的部分对应关系,我们发现这些表征既可以被投影到一个通用表征中(被命名为相对表征,Relative Representation),也可以从一个空间直接转换到另一个空间。潜在通信允许在独立训练的神经网络之间架起桥梁,无论它们的训练方案、架构或训练所针对的数据模态如何——只要数据语义内容保持不变(例如图像及其说明文字)。这适用于生成、分类和检索下游任务;适用于监督、弱监督和无监督环境;并跨越包括图像、文本、音频和图在内的各种数据模态——展示了潜在通信现象的普遍性。[...]

英文摘要:

As NNs permeate various scientific and industrial domains, understanding the universality and reusability of their representations becomes crucial. At their core, these networks create intermediate neural representations, indicated as latent spaces, of the input data and subsequently leverage them to perform specific downstream tasks. This dissertation focuses on the universality and reusability of neural representations. Do the latent representations crafted by a NN remain exclusive to a particular trained instance, or can they generalize across models, adapting to factors such as randomness during training, model architecture, or even data domain? This adaptive quality introduces the notion of Latent Communication -- a phenomenon that describes when representations can be unified or reused across neural spaces. A salient observation from our research is the emergence of similarities in latent representations, even when these originate from distinct or seemingly unrelated NNs. By exploiting a partial correspondence between the two data distributions that establishes a semantic link, we found that these representations can either be projected into a universal representation, coined as Relative Representation, or be directly translated from one space to another. Latent Communication allows for a bridge between independently trained NN, irrespective of their training regimen, architecture, or the data modality they were trained on -- as long as the data semantic content stays the same (e.g., images and their captions). This holds true for both generation, classification and retrieval downstream tasks; in supervised, weakly supervised, and unsupervised settings; and spans various data modalities including images, text, audio, and graphs -- showcasing the universality of the Latent Communication phenomenon. [...]

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑