arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.00558eess.IVcs.CV

Physically Plausible Spectral Reconstruction from RGB Images

University of East Anglia(东英吉利大学)

Yi-Tun Lin, Graham D. Finlayson

英文摘要:

Recently Convolutional Neural Networks (CNN) have been used to reconstruct hyperspectral information from RGB images. Moreover, this spectral reconstruction problem (SR) can often be solved with good (low) error. However, these methods are not physically plausible: that is when the recovered spectra are reintegrated with the underlying camera sensitivities, the resulting predicted RGB is not the same as the actual RGB, and sometimes this discrepancy can be large. The problem is further compounded by exposure change. Indeed, most learning-based SR models train for a fixed exposure setting and we show that this can result in poor performance when exposure varies. In this paper we show how CNN learning can be extended so that physical plausibility is enforced and the problem resulting from changing exposures is mitigated. Our SR solution improves the state-of-the-art spectral recovery performance under varying exposure conditions while simultaneously ensuring physical plausibility (the recovered spectra reintegrate to the input RGBs exactly).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑