面向抗噪视觉感知的计算优先光学检测
Compute-first optical detection for noise-resilient visual perception
AI总结:
本文提出计算优先光学检测概念,通过在检测前用线性变换器对光学信号进行空间重分布,提升视觉感知任务在噪声环境下的鲁棒性,并在MNIST分类和非相干成像系统中验证了其有效性。
摘要:
在视觉感知中,场景的光学信号由探测器以图像数据的形式转换到电子域,随后被处理以提取视觉信息。然而,在诸如夜视应用中的热成像等噪声大、信号弱的环境中,神经计算任务的性能因噪声检测导致的数据质量固有退化而面临显著瓶颈。在此,我们提出一种在检测之前进行光学信号处理的概念以解决这一问题。我们证明,通过适当设计的线性变换器对光学信号进行空间重分布,可以增强视觉感知任务的检测噪声鲁棒性,并以MNIST分类作为基准进行了验证。我们的想法得到了定量分析的支持,该分析详细阐述了信号集中度与噪声鲁棒性之间的关系,以及其在非相干成像系统中的实际实现。这种计算优先检测方案可以为推进广泛用于工业和国防应用的红外机器视觉技术铺平道路。
英文摘要:
In the context of visual perception, the optical signal from a scene is transferred into the electronic domain by detectors in the form of image data, which are then processed for the extraction of visual information. In noisy and weak-signal environments such as thermal imaging for night vision applications, however, the performance of neural computing tasks faces a significant bottleneck due to the inherent degradation of data quality upon noisy detection. Here, we propose a concept of optical signal processing before detection to address this issue. We demonstrate that spatially redistributing optical signals through a properly designed linear transformer can enhance the detection noise resilience of visual perception tasks, as benchmarked with the MNIST classification. Our idea is supported by a quantitative analysis detailing the relationship between signal concentration and noise robustness, as well as its practical implementation in an incoherent imaging system. This compute-first detection scheme can pave the way for advancing infrared machine vision technologies widely used for industrial and defense applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。