自我编码感觉替代
Autoencoding sensory substitution
摘要：
数千万人失明，而且人数还在不断增加。视觉到听觉的感觉替代（SS）包括一系列廉价的通用解决方案，通过声音传递视觉信息来帮助视力受损者。所需的党卫军培训是漫长的：需要几个月的努力才能达到实际的适应水平。训练过程繁琐的原因有两个：拉长的替代音频信号和忽视人类听觉系统的压缩特性。为了克服这些障碍，我们开发了一类新的SS方法，通过训练深度递归自编码器进行图像到声音的转换。我们成功地在不同的数据集上训练了深度学习模型，以执行视觉到听觉刺激的转换。通过限制视觉空间，我们证明了缩短的替代音频信号的可行性，同时提出了一些机制，如计算听力模型的整合，以最佳方式传达替代刺激中的视觉特征作为感知可辨别的听觉成分。我们在两个不同的案例中测试了我们的方法。在第一个实验中，作者被蒙住眼睛5天，同时进行手姿势辨别的SS训练。第二个实验评估了向桌子上的物体移动的准确性。在这两个测试案例中，经过几个小时的训练后，都达到了高于偶然水平的准确性。我们新颖的SS架构拓宽了为视障人士设计的康复方法的视野。对所提出的模型的进一步改进将加速盲人的康复，并因此更广泛地适应SS设备。
英文摘要：
Tens of millions of people live blind, and their number is ever increasing. Visual-to-auditory sensory substitution (SS) encompasses a family of cheap, generic solutions to assist the visually impaired by conveying visual information through sound. The required SS training is lengthy: months of effort is necessary to reach a practical level of adaptation. There are two reasons for the tedious training process: the elongated substituting audio signal, and the disregard for the compressive characteristics of the human hearing system. To overcome these obstacles, we developed a novel class of SS methods, by training deep recurrent autoencoders for image-to-sound conversion. We successfully trained deep learning models on different datasets to execute visual-to-auditory stimulus conversion. By constraining the visual space, we demonstrated the viability of shortened substituting audio signals, while proposing mechanisms, such as the integration of computational hearing models, to optimally convey visual features in the substituting stimulus as perceptually discernible auditory components. We tested our approach in two separate cases. In the first experiment, the author went blindfolded for 5 days, while performing SS training on hand posture discrimination. The second experiment assessed the accuracy of reaching movements towards objects on a table. In both test cases, above-chance-level accuracy was attained after a few hours of training. Our novel SS architecture broadens the horizon of rehabilitation methods engineered for the visually impaired. Further improvements on the proposed model shall yield hastened rehabilitation of the blind and a wider adaptation of SS devices as a consequence.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
